Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support svd_merge_lora.py #1117

Closed
blooest opened this issue Jul 4, 2023 · 1 comment
Closed

Support svd_merge_lora.py #1117

blooest opened this issue Jul 4, 2023 · 1 comment
Labels
enhancement New feature or request

Comments

@blooest
Copy link

blooest commented Jul 4, 2023

As opposed to the merge_lora.py which allows for merging into a checkpoint, svd_merge_lora.py is strictly for standalone merges. But, it supports both mismatched dims, and LyCORIS merging. Two things sorely lacking from merge_lora.py, and from this GUI.

To make things easier on you from a dev standpoint, it supports the same --precision, --save_precision, --models, --ratios, --save_to args as the normal merge_lora.py. It drops --sd_model for obvious reasons, as well as --v2, presumably also because it's not loading a checkpoint. It adds --new_rank and --new_conv_rank for LoRA rank and Conv2D rank respectively, which can work like your rank sliders in other tabs (e.g. fixed locon extraction), and --device, which can also work like it does in other tabs.

Thanks!

@bmaltais bmaltais added the enhancement New feature or request label Jul 4, 2023
@bmaltais
Copy link
Owner

bmaltais commented Jul 4, 2023

I will look at adding it to the tools for the next release.

bmaltais pushed a commit that referenced this issue Feb 18, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants