Add vllm serve
to wrap vllm.entrypoints.openai.api_server
#5349
Job | Run time |
---|---|
12s | |
8s | |
14s | |
10s | |
44s |
vllm serve
to wrap vllm.entrypoints.openai.api_server
#5349
Job | Run time |
---|---|
12s | |
8s | |
14s | |
10s | |
44s |