Change `--auto-devices` and model offload behavior#24

Closed

ghost wants to merge 6 commits intomainfrom unknown repository

+43-17

Commits on Jan 24, 2023

Make device_map='auto' optional
81300
committed
Add .gitignore
81300
committed
Merge branch 'oobabooga:main' into autodevices
81300
authored
Merge branch 'oobabooga:main' into autodevices
81300
authored

Commits on Jan 25, 2023

Ensure input_ids get placed on the correct device before calling generate()
81300
committed
Merge branch 'autodevices' of github.com:81300/text-generation-webui into autodevices
81300
committed