Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

v22.6.2 #1995

Merged
merged 91 commits into from
Feb 24, 2024
Merged

v22.6.2 #1995

merged 91 commits into from
Feb 24, 2024

Conversation

bmaltais
Copy link
Owner

  • 2024/02/24 (v22.6.2)
  • Fix issue with Lora Extract GUI
    • Fix syntax issue where parameter lora_network_weights is actually called network_weights
  • Merge sd-scripts v0.8.4 code update
    • Fixed a bug that the VRAM usage without Text Encoder training is larger than before in training scripts for LoRA etc (train_network.py, sdxl_train_network.py).
      • Text Encoders were not moved to CPU.
    • Fixed typos. Thanks to akx! PR #1053
    • The log output has been improved. PR #905 Thanks to shirayu!
      • The log is formatted by default. The rich library is required. Please see Upgrade and update the library.
      • If rich is not installed, the log output will be the same as before.
      • The following options are available in each training script:
      • --console_log_simple option can be used to switch to the previous log output.
      • --console_log_level option can be used to specify the log level. The default is INFO.
      • --console_log_file option can be used to output the log to a file. The default is None (output to the console).
    • The sample image generation during multi-GPU training is now done with multiple GPUs. PR #1061 Thanks to DKnight54!
    • The support for mps devices is improved. PR #1054 Thanks to akx! If mps device exists instead of CUDA, the mps device is used automatically.
    • The --new_conv_rank option to specify the new rank of Conv2d is added to networks/resize_lora.py. PR #1102 Thanks to mgz-dev!
    • An option --highvram to disable the optimization for environments with little VRAM is added to the training scripts. If you specify it when there is enough VRAM, the operation will be faster.
      • Currently, only the cache part of latents is optimized.
    • The IPEX support is improved. PR #1086 Thanks to Disty0!
    • Fixed a bug that svd_merge_lora.py crashes in some cases. PR #1087 Thanks to mgz-dev!
    • DyLoRA is fixed to work with SDXL. PR #1126 Thanks to tamlog06!
    • The common image generation script gen_img.py for SD 1/2 and SDXL is added. The basic functions are the same as the scripts for SD 1/2 and SDXL, but some new features are added.
      • External scripts to generate prompts can be supported. It can be called with --from_module option. (The documentation will be added later)
      • The normalization method after prompt weighting can be specified with --emb_normalize_mode option. original is the original method, abs is the normalization with the average of the absolute values, none is no normalization.
    • Gradual Latent Hires fix is added to each generation script. See here for details.

kohya-ss and others added 30 commits November 23, 2023 22:17
remove missing import, and remove unused imports
fix broken import in svd_merge_lora script
Device support improvements (MPS)
Fix IPEX support and add XPU device to device_utils
…1061)

* Update train_util.py

Modifying to attempt enable multi GPU inference

* Update train_util.py

additional VRAM checking, refactor check_vram_usage to return string for use with accelerator.print

* Update train_network.py

* Update train_util.py

* Update train_util.py

* Update train_util.py

* Update train_util.py

* Update train_util.py

* Update train_util.py

* Update train_util.py

* Update train_util.py

* Update train_util.py

* Update train_util.py

* Update train_util.py

* Update train_util.py

* Update train_util.py

* Update train_util.py

* Update train_util.py

* Update train_util.py

remove sample image debug outputs

* Update train_util.py

* Update train_util.py

* Update train_network.py

* Update train_util.py

* Update train_util.py

* Update train_util.py

* Update train_util.py

* Update train_util.py

* Update train_util.py

* Update train_util.py

* Update train_util.py

* Update train_util.py

* Update train_network.py

* Update train_util.py

* Update train_network.py

* Update train_network.py

* Update train_network.py

* Cleanup of debugging outputs

* adopt more elegant coding

Co-authored-by: Aarni Koskela <akx@iki.fi>

* Update train_util.py

Fix leftover debugging code
attempt to refactor inference into separate function

* refactor in function generate_per_device_prompt_list() generation of distributed prompt list

* Clean up missing variables

* fix syntax error

* Update train_util.py

* Update train_util.py

* Update train_util.py

* Update train_util.py

* Update train_util.py

* Update train_util.py

* Update train_util.py

* Update train_util.py

* true random sample image generation

update code to reinitialize random seed to true random if seed was set

* true random sample image generation

* simplify per process prompt

* Update train_util.py

* Update train_util.py

* Update train_util.py

* Update train_util.py

* Update train_util.py

* Update train_util.py

* Update train_util.py

* Update train_util.py

* Update train_network.py

* Update train_network.py

* Update train_network.py

---------

Co-authored-by: Aarni Koskela <akx@iki.fi>
jim60105 and others added 29 commits February 18, 2024 09:59
Signed-off-by: 陳鈞 <jim60105@gmail.com>
Too big to run on GitHub free runner.
Error: no space left on device

This reverts commit fc029d7.

Signed-off-by: 陳鈞 <jim60105@gmail.com>
…:3.10-slim

- Change the base image from `python:3.10` to `python:3.10-slim`
- Expose ports `7860` and `6006` in the Dockerfile

Signed-off-by: 陳鈞 <jim60105@gmail.com>
- Switch to a slim variant of the Python 3.10 Docker image for the build stage.
- Introduce a conditional installation of `pillow-simd` replacing `pillow`, specific to x86 architecture.
- Add required dependencies for `pillow-simd` installation, along with cleanup commands to remove unnecessary package lists after installation.
- Update runtime dependencies by adding `libtcl8.6` and `libtk8.6` to the final Docker image.

Signed-off-by: 陳鈞 <jim60105@gmail.com>
Signed-off-by: 陳鈞 <jim60105@gmail.com>
Nicer formatting for options.
Fixed unclosed formatting
Optimize the Dockerfile to reduce the size of the image. (50.76 GB to 19.04 GB)
Fix dylora create_modules error when training sdxl
@bmaltais bmaltais merged commit 5d77bf4 into master Feb 24, 2024
0 of 2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

10 participants