Skip to content

server: benchmark: chat/completions scenario and other llm servers comparison #9451

server: benchmark: chat/completions scenario and other llm servers comparison

server: benchmark: chat/completions scenario and other llm servers comparison #9451

Job Run time
3m 59s
3m 20s
5m 30s
5m 22s
1m 45s
2m 24s
2m 16s
2m 25s
2m 27s
6m 41s
5m 33s
5m 36s
1m 9s
22m 0s
11m 40s
14s
21s
6m 20s
14s
5m 31s
12s
5m 49s
8s
5m 14s
5m 29s
19m 7s
17m 4s
13m 17s
19m 11s
3m 36s
5m 40s
4m 53s
3m 36s
0s
3h 18m 3s