server: benchmark: chat/completions scenario and other llm servers comparison #9451
Job | Run time |
---|---|
3m 59s | |
3m 20s | |
5m 30s | |
5m 22s | |
1m 45s | |
2m 24s | |
2m 16s | |
2m 25s | |
2m 27s | |
6m 41s | |
5m 33s | |
5m 36s | |
1m 9s | |
22m 0s | |
11m 40s | |
14s | |
21s | |
6m 20s | |
14s | |
5m 31s | |
12s | |
5m 49s | |
8s | |
5m 14s | |
5m 29s | |
19m 7s | |
17m 4s | |
13m 17s | |
19m 11s | |
3m 36s | |
5m 40s | |
4m 53s | |
3m 36s | |
0s | |
3h 18m 3s |