Using TGI official release docker image for intel cpu #268
Job | Run time |
---|---|
4s | |
6s | |
5s | |
4s | |
6s | |
8s | |
8s | |
3s | |
3s | |
3s | |
9m 59s | |
6m 53s | |
5m 17s | |
5m 26s | |
17m 51s | |
9m 44s | |
9m 57s | |
8m 49s | |
8m 3s | |
7m 20s | |
1h 30m 9s |
Job | Run time |
---|---|
4s | |
6s | |
5s | |
4s | |
6s | |
8s | |
8s | |
3s | |
3s | |
3s | |
9m 59s | |
6m 53s | |
5m 17s | |
5m 26s | |
17m 51s | |
9m 44s | |
9m 57s | |
8m 49s | |
8m 3s | |
7m 20s | |
1h 30m 9s |