[Bug]: 'ActorHandle' object has no attribute 'decoding_config' when setting --engine-use-ray
#4317
Labels
bug
Something isn't working
--engine-use-ray
#4317
Your current environment
🐛 Describe the bug
I used this command to run Meta-Llama-3-70B-Instruct:
Server was started successfully:
I requested the server with this body:
But I got an error from the vllm server:
It is sililary as #3517, but my vLLM version is 0.4.1+cu122, built from a37d815b83849b5a96a182929dd6f3bd35f68fb8. The issue probably could not be raised again.
The text was updated successfully, but these errors were encountered: