Add vllm serve
to wrap vllm.entrypoints.openai.api_server
#6938
Job | Run time |
---|---|
50s | |
43s | |
50s | |
33s | |
2m 56s |
vllm serve
to wrap vllm.entrypoints.openai.api_server
#6938
Job | Run time |
---|---|
50s | |
43s | |
50s | |
33s | |
2m 56s |