update auto device map for AutoModel

README.md

@@ -89,14 +89,16 @@ import torch
 from transformers import AutoModelForCausalLM
 
 model = AutoModelForCausalLM.from_pretrained("q-future/one-align", trust_remote_code=True, 
-                                             torch_dtype=torch.float16, device_map={"":"cuda:0"})
+                                             torch_dtype=torch.float16, device_map="auto")
 
 from PIL import Image
 model.score([Image.open(requests.get("https://raw.githubusercontent.com/Q-Future/Q-Align/main/fig/singapore_flyer.jpg",
                                      stream=True).raw)], task_="quality", input_="image") # task_ : quality | aesthetics; # input_: image | video
 ```
 ## Quick Start
 
+We have fixed the multi-GPU inference problem.
+
 ### Image Quality Scorer
 
 - CLI Interface