Code

merge dev to main#1879

Code

Merged

kohya-ss merged 140 commits intomainkohya-ss/sd-scripts:mainfrom devkohya-ss/sd-scripts:devCopy head branch name to clipboardJan 17, 2025

+1,871-456

Commits

Commits on Apr 1, 2024

• Add LoRA+ support

  rockerBOO

  committed
  f99fe28

  Copy full SHA for f99fe28

• Add LoRA-FA for LoRA+

  rockerBOO

  committed
  c769160

  Copy full SHA for c769160

Commits on Apr 3, 2024

• Fix default_lr being applied

  rockerBOO

  committed
  1933ab4

  Copy full SHA for 1933ab4

Commits on Apr 8, 2024

• Fix default LR, Add overall LoRA+ ratio, Add log

  Show description for 75833e8
  rockerBOO

  committed
  75833e8

  Copy full SHA for 75833e8

Commits on Apr 11, 2024

• Fix unset or invalid LR from making a param_group

  rockerBOO

  committed
  68467bd

  Copy full SHA for 68467bd

Commits on Apr 14, 2024

• Fused backward pass

  2kpr

  committed
  4f203ce

  Copy full SHA for 4f203ce

Commits on Apr 16, 2024

• add disable_mmap to args

  Zovjsra

  committed
  64916a3

  Copy full SHA for 64916a3

Commits on Apr 19, 2024

• Display name of error latent file

  Show description for feefcf2
  Cauldrath

  committed
  feefcf2

  Copy full SHA for feefcf2

• Allow negative learning rate

  Show description for fc37437
  Cauldrath

  committed
  fc37437

  Copy full SHA for fc37437

Commits on Apr 20, 2024

• passing filtered hyperparameters to accelerate

  ccharest93

  committed
  2c9db5d

  Copy full SHA for 2c9db5d

• fix train controlnet

  sdbds

  committed
  4477116

  Copy full SHA for 4477116

• Cleaned typing to be in line with accelerate hyperparameters type resctrictions

  ccharest93

  committed
  b886d0a

  Copy full SHA for b886d0a

• Update train_util.py

  sdbds

  committed
  5cb145d

  Copy full SHA for 5cb145d

Commits on Apr 21, 2024

• disable main process check for deepspeed #1247

  kohya-ss

  committed
  52652cb

  Copy full SHA for 52652cb

• pop weights if available #1247

  kohya-ss

  committed
  0540c33

  Copy full SHA for 0540c33

• Regenerate failed file

  Show description for 040e26f
  Cauldrath

  committed
  040e26f

  Copy full SHA for 040e26f

Commits on Apr 23, 2024

• removed unnecessary torch import on line 115

  Show description for fdbb03c
  frodo821

  authored
  fdbb03c

  Copy full SHA for fdbb03c

Commits on Apr 29, 2024

• Merge pull request #1233 from rockerBOO/lora-plus

  Show description for 834445a
  kohya-ss

  authored
  834445a

  Copy full SHA for 834445a

• move loraplus args from args to network_args, simplify log lr desc

  kohya-ss

  committed
  969f82a

  Copy full SHA for 969f82a

Commits on May 2, 2024

• Fix caption_separator missing in subset schema

  rockerBOO

  authored
  dbb7bb2

  Copy full SHA for dbb7bb2

• Add caption_separator to output for subset

  rockerBOO

  authored
  8db0cad

  Copy full SHA for 8db0cad

Commits on May 3, 2024

• support block dim/lr for sdxl

  kohya-ss

  committed
  58c2d85

  Copy full SHA for 58c2d85

Commits on May 4, 2024

• add debug log

  kohya-ss

  committed
  52e64c6

  Copy full SHA for 52e64c6

Commits on May 6, 2024

• update loraplus on dylora/lofa_fa

  kohya-ss

  committed
  7fe8150

  Copy full SHA for 7fe8150

• fix dylora loraplus

  kohya-ss

  committed
  3fd8cdc

  Copy full SHA for 3fd8cdc

• Merge pull request #1259 from 2kpr/fused_backward_pass

  Show description for 2a359e0
  kohya-ss

  authored
  2a359e0

  Copy full SHA for 2a359e0

• update help message for fused_backward_pass

  kohya-ss

  committed
  017b82e

  Copy full SHA for 017b82e

• add experimental option to fuse params to optimizer groups

  kohya-ss

  committed
  b56d5f7

  Copy full SHA for b56d5f7

Commits on May 7, 2024

• fix get_trainable_params in controlnet-llite training

  aria1th

  authored
  793aeb9

  Copy full SHA for 793aeb9

Commits on May 12, 2024

• chore: Refactor optimizer group

  kohya-ss

  committed
  607e041

  Copy full SHA for 607e041

• update readme

  kohya-ss

  committed
  c1ba0b4

  Copy full SHA for c1ba0b4

• Merge branch 'dev' into fused-backward-pass

  kohya-ss

  committed
  6dbc23c

  Copy full SHA for 6dbc23c

• update README for fused optimizer

  kohya-ss

  committed
  f3d2cf2

  Copy full SHA for f3d2cf2

• update README for fused optimizer

  kohya-ss

  committed
  bee8cee

  Copy full SHA for bee8cee

• Merge pull request #1319 from kohya-ss/fused-backward-pass

  Show description for 7983d3d
  kohya-ss

  authored
  7983d3d

  Copy full SHA for 7983d3d

• Merge branch 'dev' into lora-plus

  kohya-ss

  committed
  e9f3a62

  Copy full SHA for e9f3a62

• Merge branch 'dev' into lora-plus

  kohya-ss

  committed
  e01e148

  Copy full SHA for e01e148

• fix typo

  kohya-ss

  committed
  1ffc0b3

  Copy full SHA for 1ffc0b3

• Merge branch 'dev' into lora-plus

  kohya-ss

  committed
  c6a4370

  Copy full SHA for c6a4370

• revert lora+ for lora_fa

  kohya-ss

  committed
  3c8193f

  Copy full SHA for 3c8193f

• update docs etc.

  kohya-ss

  committed
  4419041

  Copy full SHA for 4419041

• Merge pull request #1331 from kohya-ss/lora-plus

  Show description for 02298e3
  kohya-ss

  authored
  02298e3

  Copy full SHA for 02298e3

• Merge pull request #1266 from Zovjsra/feature/disable-mmap

  Show description for 8d1b1ac
  kohya-ss

  authored
  8d1b1ac

  Copy full SHA for 8d1b1ac

• update readme and help message etc.

  kohya-ss

  committed
  9ddb4d7

  Copy full SHA for 9ddb4d7

• Merge pull request #1278 from Cauldrath/catch_latent_error_file

  Show description for 7802093
  kohya-ss

  authored
  7802093

  Copy full SHA for 7802093

• raise original error if error is occured in checking latents

  kohya-ss

  committed
  3701507

  Copy full SHA for 3701507

• update readme

  kohya-ss

  committed
  39b82f2

  Copy full SHA for 39b82f2

• Merge pull request #1291 from frodo821/patch-1

  Show description for e96a521
  kohya-ss

  authored
  e96a521

  Copy full SHA for e96a521

• Merge pull request #1312 from rockerBOO/patch-2

  Show description for 1c296f7
  kohya-ss

  authored
  1c296f7

  Copy full SHA for 1c296f7

• Merge pull request #1313 from rockerBOO/patch-3

  Show description for a384bf2
  kohya-ss

  authored
  a384bf2

  Copy full SHA for a384bf2

• fix create_network_from_weights doesn't work

  kohya-ss

  committed
  16677da

  Copy full SHA for 16677da

Commits on May 13, 2024

• update README

  kohya-ss

  committed
  589c2aa

  Copy full SHA for 589c2aa

Commits on May 15, 2024

• add prompt option '--f' for filename

  kohya-ss

  committed
  153764a

  Copy full SHA for 153764a

Commits on May 18, 2024

• support Diffusers' based SDXL LoRA key for inference

  kohya-ss

  committed
  146edce

  Copy full SHA for 146edce

Commits on May 19, 2024

• update README

  kohya-ss

  committed
  2f19175

  Copy full SHA for 2f19175

• Merge pull request #1322 from aria1th/patch-1

  Show description for 0640f01
  kohya-ss

  authored
  0640f01

  Copy full SHA for 0640f01

• update README and format code

  kohya-ss

  committed
  e3ddd1f

  Copy full SHA for e3ddd1f

• Merge pull request #1285 from ccharest93/main

  Show description for 47187f7
  kohya-ss

  authored
  47187f7

  Copy full SHA for 47187f7

• add --log_config option to enable/disable output training config

  kohya-ss

  committed
  c68baae

  Copy full SHA for c68baae

• Merge pull request #1284 from sdbds/fix_traincontrolnet

  Show description for de0e0b9
  kohya-ss

  authored
  de0e0b9

  Copy full SHA for de0e0b9

• remove dependency for omegaconf #ref 1284

  kohya-ss

  committed
  e4d9e3c

  Copy full SHA for e4d9e3c

• Merge pull request #1277 from Cauldrath/negative_learning

  Show description for 38e4c60
  kohya-ss

  authored
  38e4c60

  Copy full SHA for 38e4c60

• update README

  kohya-ss

  committed
  4c79812

  Copy full SHA for 4c79812

• update README

  kohya-ss

  committed
  febc5c5

  Copy full SHA for febc5c5

• 画像のアルファチャンネルをlossのマスクとして使用するオプションを追加 (#1223)

  Show description for db67529
  u-haru

  authored
  db67529

  Copy full SHA for db67529

• revert kwargs to explicit declaration

  kohya-ss

  committed
  f2dd43e

  Copy full SHA for f2dd43e

• simplify and update alpha mask to work with various cases

  kohya-ss

  committed
  da6fea3

  Copy full SHA for da6fea3

Commits on May 24, 2024

• Add LoRA+ LR Ratio info message to logger

  rockerBOO

  committed
  00513b9

  Copy full SHA for 00513b9

Commits on May 26, 2024

• Merge pull request #1347 from rockerBOO/lora-plus-log-info

  Show description for fb12b6d
  kohya-ss

  authored
  fb12b6d

  Copy full SHA for fb12b6d

• fix to work cond mask and alpha mask

  kohya-ss

  committed
  e8cfd4b

  Copy full SHA for e8cfd4b

Commits on May 27, 2024

• Update issue link

  rockerBOO

  authored
  d50c1b3

  Copy full SHA for d50c1b3

• Merge branch 'dev' into alpha-masked-loss

  kohya-ss

  committed
  58cadf4

  Copy full SHA for 58cadf4

• add doc for mask loss

  kohya-ss

  committed
  a4c3155

  Copy full SHA for a4c3155

• Merge pull request #1349 from rockerBOO/patch-4

  Show description for ffce3b5
  kohya-ss

  authored
  ffce3b5

  Copy full SHA for ffce3b5

• Update masked_loss_README-ja.md

  Show description for 71ad3c0
  kohya-ss

  authored
  71ad3c0

  Copy full SHA for 71ad3c0

• Merge branch 'dev' into alpha-masked-loss

  kohya-ss

  committed
  2870be9

  Copy full SHA for 2870be9

• update docs for masked loss

  kohya-ss

  committed
  fc85496

  Copy full SHA for fc85496

• Merge pull request #1339 from kohya-ss/alpha-masked-loss

  Show description for 0d96e10
  kohya-ss

  authored
  0d96e10

  Copy full SHA for 0d96e10

Commits on May 31, 2024

• Final implementation

  KohakuBlueleaf

  committed
  b2363f1

  Copy full SHA for b2363f1

• Skip the final 1 step

  KohakuBlueleaf

  committed
  3eb27ce

  Copy full SHA for 3eb27ce

Commits on Jun 2, 2024

• fix alpha mask without disk cache closes #1351, ref #1339

  kohya-ss

  committed
  e5bab69

  Copy full SHA for e5bab69

Commits on Jun 4, 2024

• Merge pull request #1353 from KohakuBlueleaf/train_resume_step

  Show description for 321e24d
  kohya-ss

  authored
  321e24d

  Copy full SHA for 321e24d

• update for corner cases

  kohya-ss

  committed
  4dbcef4

  Copy full SHA for 4dbcef4

Commits on Jun 5, 2024

• Bump crate-ci/typos from 1.19.0 to 1.21.0, fix typos, and updated _typos.toml (Close #1307)

  shirayu

  committed
  4ecbac1

  Copy full SHA for 4ecbac1

Commits on Jun 6, 2024

• Merge pull request #1361 from shirayu/update/github_actions/crate-ci/typos-1.21.0

  Show description for 5bfe5e4
  kohya-ss

  authored
  5bfe5e4

  Copy full SHA for 5bfe5e4

Commits on Jun 9, 2024

• set static graph flag when DDP ref #1363

  kohya-ss

  committed
  58fb648

  Copy full SHA for 58fb648

• make forward/backward pathes same ref #1363

  kohya-ss

  committed
  1a104dc

  Copy full SHA for 1a104dc

• Merge branch 'dev' of https://github.com/kohya-ss/sd-scripts into dev

  kohya-ss

  committed
  3259928

  Copy full SHA for 3259928

Commits on Jun 11, 2024

• Merge branch 'dev' into train_resume_step

  kohya-ss

  committed
  4a44188

  Copy full SHA for 4a44188

• update README

  kohya-ss

  committed
  18d7597

  Copy full SHA for 18d7597

• Merge pull request #1359 from kohya-ss/train_resume_step

  Show description for 22413a5
  kohya-ss

  authored
  22413a5

  Copy full SHA for 22413a5

Commits on Jun 12, 2024

• add grad_hook after restore state closes #1344

  kohya-ss

  committed
  56bb81c

  Copy full SHA for 56bb81c

Commits on Jun 23, 2024

• Merge branch 'main' into dev

  kohya-ss

  committed
  9dd1ee4

  Copy full SHA for 9dd1ee4

Commits on Jun 25, 2024

• show file name if error in load_image ref #1385

  kohya-ss

  committed
  0b3e4f7

  Copy full SHA for 0b3e4f7

Commits on Jul 12, 2024

• judge image size for using diff interpolation

  sdbds

  committed
  8752694

  Copy full SHA for 8752694

Commits on Jul 18, 2024

• Generate sample images without having CUDA (such as on Macs)

  millie-v

  committed
  2e67978

  Copy full SHA for 2e67978

Commits on Jul 20, 2024

• Revert "judge image size for using diff interpolation"

  Show description for 1f16b80
  sdbds

  committed
  1f16b80

  Copy full SHA for 1f16b80

• instead cv2 LANCZOS4 resize to pil resize

  sdbds

  committed
  9ca7a5b

  Copy full SHA for 9ca7a5b

Commits on Aug 11, 2024

• correct option name closes #1446

  kohya-ss

  committed
  74f91c2

  Copy full SHA for 74f91c2

Commits on Aug 22, 2024

• fix SD1.5 LoRA extraction #1490

  kohya-ss

  committed
  afb971f

  Copy full SHA for afb971f

Commits on Aug 23, 2024

• Handle args.v_parameterization properly for MinSNR and changed prediction target

  liesened

  authored
  1e8108f

  Copy full SHA for 1e8108f

Commits on Aug 24, 2024

• Merge pull request #1505 from liesened/patch-2

  Show description for 4ca29ed
  kohya-ss

  authored
  4ca29ed

  Copy full SHA for 4ca29ed

• update readme

  kohya-ss

  committed
  d5c076c

  Copy full SHA for d5c076c

Commits on Sep 7, 2024

• Merge pull request #1433 from millie-v/sample-image-without-cuda

  Show description for 319e4d9
  kohya-ss

  authored
  319e4d9

  Copy full SHA for 319e4d9

• Merge pull request #1426 from sdbds/resize

  Show description for 16bb569
  kohya-ss

  authored
  16bb569

  Copy full SHA for 16bb569

• update README, format code

  kohya-ss

  committed
  0005867

  Copy full SHA for 0005867

• Merge branch 'main' into dev

  kohya-ss

  committed
  62ec3e6

  Copy full SHA for 62ec3e6

Commits on Sep 11, 2024

• Add New lr scheduler (#1393)

  Show description for fd68703
  sdbds

  authored
  fd68703

  Copy full SHA for fd68703

• Fix to work PIECEWISE_CONSTANT, update requirement.txt and README #1393

  kohya-ss

  committed
  6dbfd47

  Copy full SHA for 6dbfd47

• fix typo

  kohya-ss

  committed
  c7c666b

  Copy full SHA for c7c666b

Commits on Sep 13, 2024

• Merge branch 'main' into dev

  kohya-ss

  committed
  9d28607

  Copy full SHA for 9d28607

• Merge branch 'main' into dev

  kohya-ss

  committed
  43ad738

  Copy full SHA for 43ad738

• improve OFT implementation closes #944

  kohya-ss

  committed
  93d9fbf

  Copy full SHA for 93d9fbf

Commits on Sep 19, 2024

• Bug fix: alpha_mask load

  Maru-mee

  authored
  e704066

  Copy full SHA for e704066

• Merge branch 'main' into dev

  kohya-ss

  committed
  d7e1472

  Copy full SHA for d7e1472

• Merge pull request #1615 from Maru-mee/patch-1

  Show description for 0b7927e
  kohya-ss

  authored
  0b7927e

  Copy full SHA for 0b7927e

Commits on Sep 21, 2024

• make timestep sampling behave in the standard way when huber loss is used

  

  recris

  committed
  e1f23af

  Copy full SHA for e1f23af

Commits on Sep 23, 2024

• retain alpha in pil_resize backport #1619

  kohya-ss

  committed
  29177d2

  Copy full SHA for 29177d2

Commits on Sep 25, 2024

• init

  sdbds

  committed
  ab7b231

  Copy full SHA for ab7b231

• Merge pull request #1628 from recris/huber-timesteps

  Show description for c1d16a7
  kohya-ss

  authored
  c1d16a7

  Copy full SHA for c1d16a7

• update README

  kohya-ss

  committed
  e74f581

  Copy full SHA for e74f581

• delete code for cleaning

  sdbds

  committed
  1beddd8

  Copy full SHA for 1beddd8

Commits on Sep 26, 2024

• fix flip_aug, alpha_mask, random_crop issue in caching

  kohya-ss

  committed
  bf91bea

  Copy full SHA for bf91bea

• Merge pull request #1640 from sdbds/ademamix8bit

  Show description for 4296e28
  kohya-ss

  authored
  4296e28

  Copy full SHA for 4296e28

• fix to work bitsandbytes optimizers with full path #1640

  kohya-ss

  committed
  a94bc84

  Copy full SHA for a94bc84

• update readme

  kohya-ss

  committed
  ce49ced

  Copy full SHA for ce49ced

Commits on Sep 29, 2024

• adjust min/max bucket reso divisible by reso steps #1632

  kohya-ss

  committed
  fe2aa32

  Copy full SHA for fe2aa32

• update help text #1632

  kohya-ss

  committed
  1567549

  Copy full SHA for 1567549

• fix to work linear/cosine scheduler closes #1651 ref #1393

  kohya-ss

  committed
  012e7e6

  Copy full SHA for 012e7e6

Commits on Oct 21, 2024

• Fix training for V-pred and ztSNR

  Show description for 8fc30f8
  catboxanon

  committed
  8fc30f8

  Copy full SHA for 8fc30f8

• Only add warning for deprecated scaling vpred loss function

  catboxanon

  committed
  e1b63c2

  Copy full SHA for e1b63c2

Commits on Oct 22, 2024

• Remove scale_v_pred_loss_like_noise_pred deprecation

  Show description for 0e7c592
  catboxanon

  committed
  0e7c592

  Copy full SHA for 0e7c592

• Remove v-pred warnings

  Show description for be14c06
  catboxanon

  committed
  be14c06

  Copy full SHA for be14c06

Commits on Oct 25, 2024

• Merge pull request #1715 from catboxanon/vpred-ztsnr-fixes

  Show description for c632af8
  kohya-ss

  authored
  c632af8

  Copy full SHA for c632af8

• Merge pull request #1717 from catboxanon/fix/remove-vpred-warnings

  Show description for b8ae745
  kohya-ss

  authored
  b8ae745

  Copy full SHA for b8ae745

• update README

  kohya-ss

  committed
  b1e6504

  Copy full SHA for b1e6504

Commits on Oct 26, 2024

• Merge branch 'main' into dev

  kohya-ss

  committed
  900d551

  Copy full SHA for 900d551

Commits on Oct 27, 2024

• Merge branch 'main' into dev

  kohya-ss

  committed
  e070bd9

  Copy full SHA for e070bd9

Commits on Nov 7, 2024

• Merge branch 'main' into dev

  kohya-ss

  committed
  6adb69b

  Copy full SHA for 6adb69b

Commits on Jan 17, 2025

• update README for merging

  kohya-ss

  committed
  345daaa

  Copy full SHA for 345daaa