Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add offload for 8-bit model #1699

Merged
merged 7 commits into from
Jul 11, 2023
Merged

Add offload for 8-bit model #1699

merged 7 commits into from
Jul 11, 2023

Commits on Jul 10, 2023

  1. Add offload for 8-bit model

    @SunMarc
    SunMarc committed Jul 10, 2023
    Configuration menu
    Copy the full SHA
    b19f9dc View commit details
    Browse the repository at this point in the history

  2. fix saved 8bit model offload and add tests

    @SunMarc
    SunMarc committed Jul 10, 2023
    Configuration menu
    Copy the full SHA
    4a0b3c7 View commit details
    Browse the repository at this point in the history

Commits on Jul 11, 2023

  1. Update src/accelerate/utils/modeling.py 

    Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
    @SunMarc @sgugger
    SunMarc and sgugger authored Jul 11, 2023
    Configuration menu
    Copy the full SHA
    e7875d5 View commit details
    Browse the repository at this point in the history

  2. Update src/accelerate/utils/modeling.py 

    Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
    @SunMarc @sgugger
    SunMarc and sgugger authored Jul 11, 2023
    Configuration menu
    Copy the full SHA
    ddeb4c2 View commit details
    Browse the repository at this point in the history

  3. add doc on how offload works

    @SunMarc
    SunMarc committed Jul 11, 2023
    Configuration menu
    Copy the full SHA
    826659a View commit details
    Browse the repository at this point in the history

  4. remove enable_offload

    @SunMarc
    SunMarc committed Jul 11, 2023
    Configuration menu
    Copy the full SHA
    50ca630 View commit details
    Browse the repository at this point in the history

  5. make style doc

    @SunMarc
    SunMarc committed Jul 11, 2023
    Configuration menu
    Copy the full SHA
    c369fb0 View commit details
    Browse the repository at this point in the history