Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

FIX low_cpu_mem_usage consolidates devices #2113

Merged
merged 1 commit into from
Oct 2, 2024
Merged

FIX low_cpu_mem_usage consolidates devices #2113

merged 1 commit into from
Oct 2, 2024

Commits on Sep 30, 2024

  1. FIX low_cpu_mem_usage consolidates devices 

    See: huggingface/diffusers#9510 (comment)

Right now, the low_cpu_mem_usage=True option does not consolidate the
devices. E.g. when the model is on GPU and the state_dict on CPU, the
adapter weight will be on CPU after loading, when it should be GPU. This
fix ensures that the devices are consolidated.
    @BenjaminBossan
    BenjaminBossan committed Sep 30, 2024
    Configuration menu
    Copy the full SHA
    3e44670 View commit details
    Browse the repository at this point in the history