Add vllm serve
to wrap vllm.entrypoints.openai.api_server
#366
Job | Run time |
---|---|
20s | |
19s | |
16s | |
17s | |
1m 12s |
vllm serve
to wrap vllm.entrypoints.openai.api_server
#366
Job | Run time |
---|---|
20s | |
19s | |
16s | |
17s | |
1m 12s |