New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

这个提示一般是显存超了，可以考虑用4bit量化，或者对话论数不要太长 #335

Closed

lulianLiu opened this issue Apr 2, 2023 · 1 comment

lulianLiu commented Apr 2, 2023

          这个提示一般是显存超了，可以考虑用4bit量化，或者对话论数不要太长

Originally posted by @duzx16 in #88 (comment)
I have use the 4bit, but the same error.How to solve it?

The text was updated successfully, but these errors were encountered:

hechuanlong commented Apr 2, 2023 •

edited

Loading

4bit和8bit量化我也试过，也是不行，都准备深入去分析里面的代码了，后来发现这样改可以 #347

duzx16 closed this as completed

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment