We have tested kinds of neural network models with Bolt(v0.2.0) on HUAWEI 810 mobile phone and HUAWEI 990 mobile phone respectively. The benchmark data are given under different operating systems, different computing cores, and different inference accuracy. For more detailed evaluation data, please refer to the following table.
| Model | Framework | Os | Compiler | Kirin Soc Version | Core | Precision | Cpu or Gpu | Thread | Input Size | Performance1 | Performance2 | Performance3 | Accuracy1 | Accuracy2 |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| tinybert | caffe | ubuntu16_04 | gcc8.3 | 810 | A55 | fp32 | cpu | 1 | 32+32+32 | avg_time:17.5701ms/sequence | ||||
| tinybert | caffe | ubuntu16_04 | gcc8.3 | 810 | A55 | fp16 | cpu | 1 | 32+32+32 | avg_time:9.3479ms/sequence | ||||
| tinybert | caffe | ubuntu16_04 | gcc8.3 | 810 | A76 | fp32 | cpu | 1 | 32+32+32 | avg_time:4.48315ms/sequence | ||||
| tinybert | caffe | ubuntu16_04 | gcc8.3 | 810 | A76 | fp16 | cpu | 1 | 32+32+32 | avg_time:2.6499ms/sequence | ||||
| tinybert | caffe | ubuntu16_04 | gcc8.3 | 990 | A55 | fp32 | cpu | 1 | 32+32+32 | avg_time:16.9138ms/sequence | ||||
| tinybert | caffe | ubuntu16_04 | gcc8.3 | 990 | A55 | fp16 | cpu | 1 | 32+32+32 | avg_time:8.96313ms/sequence | ||||
| tinybert | caffe | ubuntu16_04 | gcc8.3 | 990 | A76 | fp32 | cpu | 1 | 32+32+32 | avg_time:3.69189ms/sequence | ||||
| tinybert | caffe | ubuntu16_04 | gcc8.3 | 990 | A76 | fp16 | cpu | 1 | 32+32+32 | avg_time:2.2041ms/sequence | ||||
| tinybert | caffe | ubuntu16_04 | llvm | 810 | A55 | fp32 | cpu | 1 | 32+32+32 | avg_time:16.96ms/sequence | ||||
| tinybert | caffe | ubuntu16_04 | llvm | 810 | A55 | fp16 | cpu | 1 | 32+32+32 | avg_time:8.88281ms/sequence | ||||
| tinybert | caffe | ubuntu16_04 | llvm | 810 | A76 | fp32 | cpu | 1 | 32+32+32 | avg_time:4.39697ms/sequence | ||||
| tinybert | caffe | ubuntu16_04 | llvm | 810 | A76 | fp16 | cpu | 1 | 32+32+32 | avg_time:2.84619ms/sequence | ||||
| tinybert | caffe | ubuntu16_04 | llvm | 990 | A55 | fp32 | cpu | 1 | 32+32+32 | avg_time:15.3071ms/sequence | ||||
| tinybert | caffe | ubuntu16_04 | llvm | 990 | A55 | fp16 | cpu | 1 | 32+32+32 | avg_time:8.33203ms/sequence | ||||
| tinybert | caffe | ubuntu16_04 | llvm | 990 | A76 | fp32 | cpu | 1 | 32+32+32 | avg_time:3.84497ms/sequence | ||||
| tinybert | caffe | ubuntu16_04 | llvm | 990 | A76 | fp16 | cpu | 1 | 32+32+32 | avg_time:2.3479ms/sequence | ||||
| nmt | caffe | ubuntu16_04 | gcc8.3 | 810 | A55 | fp32 | cpu | 1 | 32+32+32 | avg_time:875.392ms/sequence | ||||
| nmt | caffe | ubuntu16_04 | gcc8.3 | 810 | A55 | fp16 | cpu | 1 | 32+32+32 | avg_time:497.91ms/sequence | ||||
| nmt | caffe | ubuntu16_04 | gcc8.3 | 810 | A76 | fp32 | cpu | 1 | 32+32+32 | avg_time:295.943ms/sequence | ||||
| nmt | caffe | ubuntu16_04 | gcc8.3 | 810 | A76 | fp16 | cpu | 1 | 32+32+32 | avg_time:156.86ms/sequence | ||||
| nmt | caffe | ubuntu16_04 | gcc8.3 | 990 | A55 | fp32 | cpu | 1 | 32+32+32 | avg_time:975.889ms/sequence | ||||
| nmt | caffe | ubuntu16_04 | gcc8.3 | 990 | A55 | fp16 | cpu | 1 | 32+32+32 | avg_time:492.725ms/sequence | ||||
| nmt | caffe | ubuntu16_04 | gcc8.3 | 990 | A76 | fp32 | cpu | 1 | 32+32+32 | avg_time:285.426ms/sequence | ||||
| nmt | caffe | ubuntu16_04 | gcc8.3 | 990 | A76 | fp16 | cpu | 1 | 32+32+32 | avg_time:136.338ms/sequence | ||||
| nmt | caffe | ubuntu16_04 | llvm | 810 | A55 | fp32 | cpu | 1 | 32+32+32 | avg_time:874.251ms/sequence | ||||
| nmt | caffe | ubuntu16_04 | llvm | 810 | A55 | fp16 | cpu | 1 | 32+32+32 | avg_time:457.736ms/sequence | ||||
| nmt | caffe | ubuntu16_04 | llvm | 810 | A76 | fp32 | cpu | 1 | 32+32+32 | avg_time:300.887ms/sequence | ||||
| nmt | caffe | ubuntu16_04 | llvm | 810 | A76 | fp16 | cpu | 1 | 32+32+32 | avg_time:160.95ms/sequence | ||||
| nmt | caffe | ubuntu16_04 | llvm | 990 | A55 | fp32 | cpu | 1 | 32+32+32 | avg_time:854.466ms/sequence | ||||
| nmt | caffe | ubuntu16_04 | llvm | 990 | A55 | fp16 | cpu | 1 | 32+32+32 | avg_time:455.878ms/sequence | ||||
| nmt | caffe | ubuntu16_04 | llvm | 990 | A76 | fp32 | cpu | 1 | 32+32+32 | avg_time:246.937ms/sequence | ||||
| nmt | caffe | ubuntu16_04 | llvm | 990 | A76 | fp16 | cpu | 1 | 32+32+32 | avg_time:128.898ms/sequence | ||||
| ghostnet | onnx | ubuntu16_04 | gcc8.3 | 810 | A55 | fp32 | cpu | 1 | 1/3/224/224 | max_time:69.29ms/image | min_time:58.073ms/image | avg_time:59.0912ms/image | top5:0.973684 | top1:0.861842 |
| ghostnet | onnx | ubuntu16_04 | gcc8.3 | 810 | A55 | fp16 | cpu | 1 | 1/3/224/224 | max_time:34.3389ms/image | min_time:27.093ms/image | avg_time:29.1388ms/image | top5:0.973684 | top1:0.875 |
| ghostnet | onnx | ubuntu16_04 | gcc8.3 | 810 | A76 | fp32 | cpu | 1 | 1/3/224/224 | max_time:20.813ms/image | min_time:18.3352ms/image | avg_time:18.4675ms/image | top5:0.973684 | top1:0.861842 |
| ghostnet | onnx | ubuntu16_04 | gcc8.3 | 810 | A76 | fp16 | cpu | 1 | 1/3/224/224 | max_time:9.94312ms/image | min_time:8.79199ms/image | avg_time:8.85982ms/image | top5:0.973684 | top1:0.875 |
| ghostnet | onnx | ubuntu16_04 | gcc8.3 | 990 | A55 | fp32 | cpu | 1 | 1/3/224/224 | max_time:74.1409ms/image | min_time:56.3591ms/image | avg_time:59.8203ms/image | top5:0.973684 | top1:0.861842 |
| ghostnet | onnx | ubuntu16_04 | gcc8.3 | 990 | A55 | fp16 | cpu | 1 | 1/3/224/224 | max_time:36.093ms/image | min_time:25.9141ms/image | avg_time:28.1741ms/image | top5:0.973684 | top1:0.875 |
| ghostnet | onnx | ubuntu16_04 | gcc8.3 | 990 | A76 | fp32 | cpu | 1 | 1/3/224/224 | max_time:13.7258ms/image | min_time:13.3469ms/image | avg_time:13.4824ms/image | top5:0.973684 | top1:0.861842 |
| ghostnet | onnx | ubuntu16_04 | gcc8.3 | 990 | A76 | fp16 | cpu | 1 | 1/3/224/224 | max_time:7.14282ms/image | min_time:6.92798ms/image | avg_time:7.01458ms/image | top5:0.973684 | top1:0.875 |
| ghostnet | onnx | ubuntu16_04 | llvm | 810 | A55 | fp32 | cpu | 1 | 1/3/224/224 | max_time:74.3708ms/image | min_time:66.72ms/image | avg_time:67.9283ms/image | top5:0.973684 | top1:0.861842 |
| ghostnet | onnx | ubuntu16_04 | llvm | 810 | A55 | fp16 | cpu | 1 | 1/3/224/224 | max_time:36.603ms/image | min_time:32.616ms/image | avg_time:33.2657ms/image | top5:0.973684 | top1:0.868421 |
| ghostnet | onnx | ubuntu16_04 | llvm | 810 | A76 | fp32 | cpu | 1 | 1/3/224/224 | max_time:27.4438ms/image | min_time:18.6541ms/image | avg_time:18.8378ms/image | top5:0.973684 | top1:0.861842 |
| ghostnet | onnx | ubuntu16_04 | llvm | 810 | A76 | fp16 | cpu | 1 | 1/3/224/224 | max_time:15.4668ms/image | min_time:9.32104ms/image | avg_time:9.45095ms/image | top5:0.973684 | top1:0.868421 |
| ghostnet | onnx | ubuntu16_04 | llvm | 990 | A55 | fp32 | cpu | 1 | 1/3/224/224 | max_time:70.2061ms/image | min_time:55.4148ms/image | avg_time:61.4079ms/image | top5:0.973684 | top1:0.861842 |
| ghostnet | onnx | ubuntu16_04 | llvm | 990 | A55 | fp16 | cpu | 1 | 1/3/224/224 | max_time:37.0811ms/image | min_time:27.947ms/image | avg_time:29.9928ms/image | top5:0.973684 | top1:0.868421 |
| ghostnet | onnx | ubuntu16_04 | llvm | 990 | A76 | fp32 | cpu | 1 | 1/3/224/224 | max_time:15.6489ms/image | min_time:13.8831ms/image | avg_time:14.0345ms/image | top5:0.973684 | top1:0.861842 |
| ghostnet | onnx | ubuntu16_04 | llvm | 990 | A76 | fp16 | cpu | 1 | 1/3/224/224 | max_time:8.07397ms/image | min_time:7.29102ms/image | avg_time:7.38781ms/image | top5:0.973684 | top1:0.868421 |
| mobilenet_v1 | caffe | ubuntu16_04 | gcc8.3 | 810 | A55 | fp32 | cpu | 1 | 1/3/224/224 | max_time:190.538ms/image | min_time:160.101ms/image | avg_time:168.335ms/image | top5:0.894737 | top1:0.638158 |
| mobilenet_v1 | caffe | ubuntu16_04 | gcc8.3 | 810 | A55 | fp16 | cpu | 1 | 1/3/224/224 | max_time:71.125ms/image | min_time:63.7568ms/image | avg_time:67.3027ms/image | top5:0.894737 | top1:0.638158 |
| mobilenet_v1 | caffe | ubuntu16_04 | gcc8.3 | 810 | A76 | fp32 | cpu | 1 | 1/3/224/224 | max_time:50.1008ms/image | min_time:40.907ms/image | avg_time:41.3074ms/image | top5:0.894737 | top1:0.638158 |
| mobilenet_v1 | caffe | ubuntu16_04 | gcc8.3 | 810 | A76 | fp16 | cpu | 1 | 1/3/224/224 | max_time:24.7939ms/image | min_time:19.5669ms/image | avg_time:19.6895ms/image | top5:0.894737 | top1:0.638158 |
| mobilenet_v1 | caffe | ubuntu16_04 | gcc8.3 | 990 | A55 | fp32 | cpu | 1 | 1/3/224/224 | max_time:174.117ms/image | min_time:151.17ms/image | avg_time:154.917ms/image | top5:0.894737 | top1:0.638158 |
| mobilenet_v1 | caffe | ubuntu16_04 | gcc8.3 | 990 | A55 | fp16 | cpu | 1 | 1/3/224/224 | max_time:74.842ms/image | min_time:59.8052ms/image | avg_time:62.1738ms/image | top5:0.894737 | top1:0.638158 |
| mobilenet_v1 | caffe | ubuntu16_04 | gcc8.3 | 990 | A76 | fp32 | cpu | 1 | 1/3/224/224 | max_time:34.542ms/image | min_time:33.5129ms/image | avg_time:33.7169ms/image | top5:0.894737 | top1:0.638158 |
| mobilenet_v1 | caffe | ubuntu16_04 | gcc8.3 | 990 | A76 | fp16 | cpu | 1 | 1/3/224/224 | max_time:16.0791ms/image | min_time:15.8879ms/image | avg_time:15.9935ms/image | top5:0.894737 | top1:0.638158 |
| mobilenet_v1 | caffe | ubuntu16_04 | llvm | 810 | A55 | fp32 | cpu | 1 | 1/3/224/224 | max_time:178.423ms/image | min_time:167.58ms/image | avg_time:169.656ms/image | top5:0.894737 | top1:0.638158 |
| mobilenet_v1 | caffe | ubuntu16_04 | llvm | 810 | A55 | fp16 | cpu | 1 | 1/3/224/224 | max_time:77.3501ms/image | min_time:66.8999ms/image | avg_time:68.3253ms/image | top5:0.894737 | top1:0.638158 |
| mobilenet_v1 | caffe | ubuntu16_04 | llvm | 810 | A76 | fp32 | cpu | 1 | 1/3/224/224 | max_time:52.7412ms/image | min_time:41.7322ms/image | avg_time:42.0848ms/image | top5:0.894737 | top1:0.638158 |
| mobilenet_v1 | caffe | ubuntu16_04 | llvm | 810 | A76 | fp16 | cpu | 1 | 1/3/224/224 | max_time:26.1299ms/image | min_time:19.927ms/image | avg_time:20.0323ms/image | top5:0.894737 | top1:0.638158 |
| mobilenet_v1 | caffe | ubuntu16_04 | llvm | 990 | A55 | fp32 | cpu | 1 | 1/3/224/224 | max_time:173.724ms/image | min_time:151.815ms/image | avg_time:154.701ms/image | top5:0.894737 | top1:0.638158 |
| mobilenet_v1 | caffe | ubuntu16_04 | llvm | 990 | A55 | fp16 | cpu | 1 | 1/3/224/224 | max_time:74.7651ms/image | min_time:60.425ms/image | avg_time:62.6472ms/image | top5:0.894737 | top1:0.638158 |
| mobilenet_v1 | caffe | ubuntu16_04 | llvm | 990 | A76 | fp32 | cpu | 1 | 1/3/224/224 | max_time:36.054ms/image | min_time:33.9338ms/image | avg_time:34.2018ms/image | top5:0.894737 | top1:0.638158 |
| mobilenet_v1 | caffe | ubuntu16_04 | llvm | 990 | A76 | fp16 | cpu | 1 | 1/3/224/224 | max_time:17.3879ms/image | min_time:16.575ms/image | avg_time:16.7297ms/image | top5:0.894737 | top1:0.638158 |
| mobilenet_v2 | caffe | ubuntu16_04 | gcc8.3 | 810 | A55 | fp32 | cpu | 1 | 1/3/224/224 | max_time:154.487ms/image | min_time:141.754ms/image | avg_time:145.152ms/image | top5:0.940789 | top1:0.756579 |
| mobilenet_v2 | caffe | ubuntu16_04 | gcc8.3 | 810 | A55 | fp16 | cpu | 1 | 1/3/224/224 | max_time:64.2239ms/image | min_time:58.8081ms/image | avg_time:59.9808ms/image | top5:0.934211 | top1:0.756579 |
| mobilenet_v2 | caffe | ubuntu16_04 | gcc8.3 | 810 | A76 | fp32 | cpu | 1 | 1/3/224/224 | max_time:49.458ms/image | min_time:38.323ms/image | avg_time:38.5056ms/image | top5:0.940789 | top1:0.756579 |
| mobilenet_v2 | caffe | ubuntu16_04 | gcc8.3 | 810 | A76 | fp16 | cpu | 1 | 1/3/224/224 | max_time:23.1702ms/image | min_time:17.5068ms/image | avg_time:17.6611ms/image | top5:0.934211 | top1:0.756579 |
| mobilenet_v2 | caffe | ubuntu16_04 | gcc8.3 | 990 | A55 | fp32 | cpu | 1 | 1/3/224/224 | max_time:150.025ms/image | min_time:128.345ms/image | avg_time:132.484ms/image | top5:0.940789 | top1:0.756579 |
| mobilenet_v2 | caffe | ubuntu16_04 | gcc8.3 | 990 | A55 | fp16 | cpu | 1 | 1/3/224/224 | max_time:68.334ms/image | min_time:53.7939ms/image | avg_time:55.3328ms/image | top5:0.934211 | top1:0.756579 |
| mobilenet_v2 | caffe | ubuntu16_04 | gcc8.3 | 990 | A76 | fp32 | cpu | 1 | 1/3/224/224 | max_time:30.573ms/image | min_time:29.303ms/image | avg_time:29.476ms/image | top5:0.940789 | top1:0.756579 |
| mobilenet_v2 | caffe | ubuntu16_04 | gcc8.3 | 990 | A76 | fp16 | cpu | 1 | 1/3/224/224 | max_time:14.3711ms/image | min_time:13.9141ms/image | avg_time:14.0406ms/image | top5:0.934211 | top1:0.756579 |
| mobilenet_v2 | caffe | ubuntu16_04 | llvm | 810 | A55 | fp32 | cpu | 1 | 1/3/224/224 | max_time:165.334ms/image | min_time:142.623ms/image | avg_time:145.197ms/image | top5:0.940789 | top1:0.756579 |
| mobilenet_v2 | caffe | ubuntu16_04 | llvm | 810 | A55 | fp16 | cpu | 1 | 1/3/224/224 | max_time:70.1091ms/image | min_time:63.4839ms/image | avg_time:65.2859ms/image | top5:0.934211 | top1:0.756579 |
| mobilenet_v2 | caffe | ubuntu16_04 | llvm | 810 | A76 | fp32 | cpu | 1 | 1/3/224/224 | max_time:52.321ms/image | min_time:39.3108ms/image | avg_time:39.6574ms/image | top5:0.940789 | top1:0.756579 |
| mobilenet_v2 | caffe | ubuntu16_04 | llvm | 810 | A76 | fp16 | cpu | 1 | 1/3/224/224 | max_time:24.9519ms/image | min_time:17.696ms/image | avg_time:18.0272ms/image | top5:0.934211 | top1:0.756579 |
| mobilenet_v2 | caffe | ubuntu16_04 | llvm | 990 | A55 | fp32 | cpu | 1 | 1/3/224/224 | max_time:154.559ms/image | min_time:121.211ms/image | avg_time:130.884ms/image | top5:0.940789 | top1:0.756579 |
| mobilenet_v2 | caffe | ubuntu16_04 | llvm | 990 | A55 | fp16 | cpu | 1 | 1/3/224/224 | max_time:77.2429ms/image | min_time:52.5979ms/image | avg_time:57.1493ms/image | top5:0.934211 | top1:0.756579 |
| mobilenet_v2 | caffe | ubuntu16_04 | llvm | 990 | A76 | fp32 | cpu | 1 | 1/3/224/224 | max_time:34.0449ms/image | min_time:29.9241ms/image | avg_time:30.6575ms/image | top5:0.940789 | top1:0.756579 |
| mobilenet_v2 | caffe | ubuntu16_04 | llvm | 990 | A76 | fp16 | cpu | 1 | 1/3/224/224 | max_time:15.9011ms/image | min_time:14.261ms/image | avg_time:14.4966ms/image | top5:0.934211 | top1:0.756579 |
| squeezenet | caffe | ubuntu16_04 | gcc8.3 | 810 | A55 | fp32 | cpu | 1 | 1/3/224/224 | max_time:112.09ms/image | min_time:83.571ms/image | avg_time:93.3668ms/image | top5:0.875 | top1:0.618421 |
| squeezenet | caffe | ubuntu16_04 | gcc8.3 | 810 | A55 | fp16 | cpu | 1 | 1/3/224/224 | max_time:53.822ms/image | min_time:35.8259ms/image | avg_time:41.434ms/image | top5:0.881579 | top1:0.618421 |
| squeezenet | caffe | ubuntu16_04 | gcc8.3 | 810 | A55 | int8 | cpu | 1 | 1/3/224/224 | max_time:44.7251ms/image | min_time:31.103ms/image | avg_time:35.5491ms/image | top5:0.875 | top1:0.592105 |
| squeezenet | caffe | ubuntu16_04 | gcc8.3 | 810 | A76 | fp32 | cpu | 1 | 1/3/224/224 | max_time:31.9202ms/image | min_time:22.28ms/image | avg_time:22.4415ms/image | top5:0.875 | top1:0.618421 |
| squeezenet | caffe | ubuntu16_04 | gcc8.3 | 810 | A76 | fp16 | cpu | 1 | 1/3/224/224 | max_time:16.2849ms/image | min_time:11.3989ms/image | avg_time:11.5547ms/image | top5:0.881579 | top1:0.618421 |
| squeezenet | caffe | ubuntu16_04 | gcc8.3 | 810 | A76 | int8 | cpu | 1 | 1/3/224/224 | max_time:13.2561ms/image | min_time:9.74902ms/image | avg_time:9.84788ms/image | top5:0.875 | top1:0.592105 |
| squeezenet | caffe | ubuntu16_04 | gcc8.3 | 990 | A55 | fp32 | cpu | 1 | 1/3/224/224 | max_time:99.656ms/image | min_time:81.1941ms/image | avg_time:83.3297ms/image | top5:0.875 | top1:0.618421 |
| squeezenet | caffe | ubuntu16_04 | gcc8.3 | 990 | A55 | fp16 | cpu | 1 | 1/3/224/224 | max_time:47.0339ms/image | min_time:34.7532ms/image | avg_time:37.4053ms/image | top5:0.881579 | top1:0.618421 |
| squeezenet | caffe | ubuntu16_04 | gcc8.3 | 990 | A55 | int8 | cpu | 1 | 1/3/224/224 | max_time:38.6331ms/image | min_time:30.9619ms/image | avg_time:31.3992ms/image | top5:0.875 | top1:0.592105 |
| squeezenet | caffe | ubuntu16_04 | gcc8.3 | 990 | A76 | fp32 | cpu | 1 | 1/3/224/224 | max_time:18.9709ms/image | min_time:17.4961ms/image | avg_time:17.6799ms/image | top5:0.875 | top1:0.618421 |
| squeezenet | caffe | ubuntu16_04 | gcc8.3 | 990 | A76 | fp16 | cpu | 1 | 1/3/224/224 | max_time:10.2009ms/image | min_time:9.35303ms/image | avg_time:9.4497ms/image | top5:0.881579 | top1:0.618421 |
| squeezenet | caffe | ubuntu16_04 | gcc8.3 | 990 | A76 | int8 | cpu | 1 | 1/3/224/224 | max_time:8.61816ms/image | min_time:7.65796ms/image | avg_time:7.70149ms/image | top5:0.875 | top1:0.592105 |
| squeezenet | caffe | ubuntu16_04 | llvm | 810 | A55 | fp32 | cpu | 1 | 1/3/224/224 | max_time:107.665ms/image | min_time:89.8459ms/image | avg_time:91.3227ms/image | top5:0.875 | top1:0.618421 |
| squeezenet | caffe | ubuntu16_04 | llvm | 810 | A55 | fp16 | cpu | 1 | 1/3/224/224 | max_time:52.929ms/image | min_time:41.8279ms/image | avg_time:42.9839ms/image | top5:0.868421 | top1:0.618421 |
| squeezenet | caffe | ubuntu16_04 | llvm | 810 | A55 | int8 | cpu | 1 | 1/3/224/224 | max_time:39.2102ms/image | min_time:35.2351ms/image | avg_time:36.3468ms/image | top5:0.868421 | top1:0.664474 |
| squeezenet | caffe | ubuntu16_04 | llvm | 810 | A76 | fp32 | cpu | 1 | 1/3/224/224 | max_time:30.657ms/image | min_time:22.5791ms/image | avg_time:22.897ms/image | top5:0.875 | top1:0.618421 |
| squeezenet | caffe | ubuntu16_04 | llvm | 810 | A76 | fp16 | cpu | 1 | 1/3/224/224 | max_time:13.2539ms/image | min_time:11.6641ms/image | avg_time:12.1377ms/image | top5:0.868421 | top1:0.618421 |
| squeezenet | caffe | ubuntu16_04 | llvm | 810 | A76 | int8 | cpu | 1 | 1/3/224/224 | max_time:12.3049ms/image | min_time:9.78296ms/image | avg_time:10.041ms/image | top5:0.868421 | top1:0.664474 |
| squeezenet | caffe | ubuntu16_04 | llvm | 990 | A55 | fp32 | cpu | 1 | 1/3/224/224 | max_time:98.7239ms/image | min_time:81.147ms/image | avg_time:83.2495ms/image | top5:0.875 | top1:0.618421 |
| squeezenet | caffe | ubuntu16_04 | llvm | 990 | A55 | fp16 | cpu | 1 | 1/3/224/224 | max_time:45.7671ms/image | min_time:33.8918ms/image | avg_time:36.3651ms/image | top5:0.868421 | top1:0.618421 |
| squeezenet | caffe | ubuntu16_04 | llvm | 990 | A55 | int8 | cpu | 1 | 1/3/224/224 | max_time:40.23ms/image | min_time:32.166ms/image | avg_time:33.0669ms/image | top5:0.868421 | top1:0.664474 |
| squeezenet | caffe | ubuntu16_04 | llvm | 990 | A76 | fp32 | cpu | 1 | 1/3/224/224 | max_time:19.312ms/image | min_time:17.6091ms/image | avg_time:17.8038ms/image | top5:0.875 | top1:0.618421 |
| squeezenet | caffe | ubuntu16_04 | llvm | 990 | A76 | fp16 | cpu | 1 | 1/3/224/224 | max_time:10.54ms/image | min_time:9.58398ms/image | avg_time:9.73297ms/image | top5:0.868421 | top1:0.618421 |
| squeezenet | caffe | ubuntu16_04 | llvm | 990 | A76 | int8 | cpu | 1 | 1/3/224/224 | max_time:8.69287ms/image | min_time:7.7019ms/image | avg_time:7.80628ms/image | top5:0.868421 | top1:0.664474 |
| mobilenet_v3 | caffe | ubuntu16_04 | gcc8.3 | 810 | A55 | fp32 | cpu | 1 | 1/3/224/224 | max_time:39.6121ms/image | min_time:30.645ms/image | avg_time:31.2452ms/image | top5:0.809211 | top1:0.539474 |
| mobilenet_v3 | caffe | ubuntu16_04 | gcc8.3 | 810 | A55 | fp16 | cpu | 1 | 1/3/224/224 | max_time:20.4729ms/image | min_time:15.2979ms/image | avg_time:15.8074ms/image | top5:0.822368 | top1:0.546053 |
| mobilenet_v3 | caffe | ubuntu16_04 | gcc8.3 | 810 | A76 | fp32 | cpu | 1 | 1/3/224/224 | max_time:9.58984ms/image | min_time:7.26196ms/image | avg_time:7.37196ms/image | top5:0.809211 | top1:0.539474 |
| mobilenet_v3 | caffe | ubuntu16_04 | gcc8.3 | 810 | A76 | fp16 | cpu | 1 | 1/3/224/224 | max_time:6.87085ms/image | min_time:4.26001ms/image | avg_time:4.38828ms/image | top5:0.822368 | top1:0.546053 |
| mobilenet_v3 | caffe | ubuntu16_04 | gcc8.3 | 990 | A55 | fp32 | cpu | 1 | 1/3/224/224 | max_time:36.8108ms/image | min_time:26.8101ms/image | avg_time:28.4539ms/image | top5:0.809211 | top1:0.539474 |
| mobilenet_v3 | caffe | ubuntu16_04 | gcc8.3 | 990 | A55 | fp16 | cpu | 1 | 1/3/224/224 | max_time:15.5039ms/image | min_time:13.3491ms/image | avg_time:14.5589ms/image | top5:0.822368 | top1:0.546053 |
| mobilenet_v3 | caffe | ubuntu16_04 | gcc8.3 | 990 | A76 | fp32 | cpu | 1 | 1/3/224/224 | max_time:5.90894ms/image | min_time:5.72192ms/image | avg_time:5.80782ms/image | top5:0.809211 | top1:0.539474 |
| mobilenet_v3 | caffe | ubuntu16_04 | gcc8.3 | 990 | A76 | fp16 | cpu | 1 | 1/3/224/224 | max_time:3.52197ms/image | min_time:3.30493ms/image | avg_time:3.34958ms/image | top5:0.822368 | top1:0.546053 |
| mobilenet_v3 | caffe | ubuntu16_04 | llvm | 810 | A55 | fp32 | cpu | 1 | 1/3/224/224 | max_time:36.0649ms/image | min_time:31.5652ms/image | avg_time:32.6065ms/image | top5:0.809211 | top1:0.539474 |
| mobilenet_v3 | caffe | ubuntu16_04 | llvm | 810 | A55 | fp16 | cpu | 1 | 1/3/224/224 | max_time:19.0042ms/image | min_time:16.8479ms/image | avg_time:17.7286ms/image | top5:0.815789 | top1:0.539474 |
| mobilenet_v3 | caffe | ubuntu16_04 | llvm | 810 | A76 | fp32 | cpu | 1 | 1/3/224/224 | max_time:15.012ms/image | min_time:7.82007ms/image | avg_time:7.97568ms/image | top5:0.809211 | top1:0.539474 |
| mobilenet_v3 | caffe | ubuntu16_04 | llvm | 810 | A76 | fp16 | cpu | 1 | 1/3/224/224 | max_time:6.84717ms/image | min_time:4.59595ms/image | avg_time:4.69553ms/image | top5:0.815789 | top1:0.539474 |
| mobilenet_v3 | caffe | ubuntu16_04 | llvm | 990 | A55 | fp32 | cpu | 1 | 1/3/224/224 | max_time:38.3628ms/image | min_time:27.134ms/image | avg_time:29.9821ms/image | top5:0.809211 | top1:0.539474 |
| mobilenet_v3 | caffe | ubuntu16_04 | llvm | 990 | A55 | fp16 | cpu | 1 | 1/3/224/224 | max_time:20.6179ms/image | min_time:15.635ms/image | avg_time:16.1516ms/image | top5:0.815789 | top1:0.539474 |
| mobilenet_v3 | caffe | ubuntu16_04 | llvm | 990 | A76 | fp32 | cpu | 1 | 1/3/224/224 | max_time:6.75513ms/image | min_time:6.01196ms/image | avg_time:6.08447ms/image | top5:0.809211 | top1:0.539474 |
| mobilenet_v3 | caffe | ubuntu16_04 | llvm | 990 | A76 | fp16 | cpu | 1 | 1/3/224/224 | max_time:4.0332ms/image | min_time:3.573ms/image | avg_time:3.6405ms/image | top5:0.815789 | top1:0.539474 |
| fingerprint_resnet18 | caffe | ubuntu16_04 | gcc8.3 | 810 | A55 | fp32 | cpu | 1 | UNKNOWN | avg_time:6.20508ms/image | ||||
| fingerprint_resnet18 | caffe | ubuntu16_04 | gcc8.3 | 810 | A55 | fp16 | cpu | 1 | UNKNOWN | avg_time:3.82397ms/image | ||||
| fingerprint_resnet18 | caffe | ubuntu16_04 | gcc8.3 | 810 | A76 | fp32 | cpu | 1 | UNKNOWN | avg_time:6.42603ms/image | ||||
| fingerprint_resnet18 | caffe | ubuntu16_04 | gcc8.3 | 810 | A76 | fp16 | cpu | 1 | UNKNOWN | avg_time:3.63501ms/image | ||||
| fingerprint_resnet18 | caffe | ubuntu16_04 | llvm | 810 | A55 | fp32 | cpu | 1 | UNKNOWN | avg_time:5.70605ms/image | ||||
| fingerprint_resnet18 | caffe | ubuntu16_04 | llvm | 810 | A55 | fp16 | cpu | 1 | UNKNOWN | avg_time:3.38989ms/image | ||||
| fingerprint_resnet18 | caffe | ubuntu16_04 | llvm | 810 | A76 | fp32 | cpu | 1 | UNKNOWN | avg_time:5.6731ms/image | ||||
| fingerprint_resnet18 | caffe | ubuntu16_04 | llvm | 810 | A76 | fp16 | cpu | 1 | UNKNOWN | avg_time:3.521ms/image | ||||
| resnet50 | caffe | ubuntu16_04 | gcc8.3 | 810 | A55 | fp32 | cpu | 1 | 1/3/224/224 | max_time:769.38ms/image | min_time:726.458ms/image | avg_time:738.653ms/image | top5:0.934211 | top1:0.730263 |
| resnet50 | caffe | ubuntu16_04 | gcc8.3 | 810 | A55 | fp16 | cpu | 1 | 1/3/224/224 | max_time:333.544ms/image | min_time:298.813ms/image | avg_time:311.864ms/image | top5:0.934211 | top1:0.730263 |
| resnet50 | caffe | ubuntu16_04 | gcc8.3 | 810 | A76 | fp32 | cpu | 1 | 1/3/224/224 | max_time:194.501ms/image | min_time:185.442ms/image | avg_time:186.798ms/image | top5:0.934211 | top1:0.730263 |
| resnet50 | caffe | ubuntu16_04 | gcc8.3 | 810 | A76 | fp16 | cpu | 1 | 1/3/224/224 | max_time:97.8091ms/image | min_time:92.2888ms/image | avg_time:93.0512ms/image | top5:0.934211 | top1:0.730263 |
| resnet50 | caffe | ubuntu16_04 | gcc8.3 | 990 | A55 | fp32 | cpu | 1 | 1/3/224/224 | max_time:716.164ms/image | min_time:620.755ms/image | avg_time:676.802ms/image | top5:0.934211 | top1:0.730263 |
| resnet50 | caffe | ubuntu16_04 | gcc8.3 | 990 | A55 | fp16 | cpu | 1 | 1/3/224/224 | max_time:298.58ms/image | min_time:252.569ms/image | avg_time:274.926ms/image | top5:0.934211 | top1:0.730263 |
| resnet50 | caffe | ubuntu16_04 | gcc8.3 | 990 | A76 | fp32 | cpu | 1 | 1/3/224/224 | max_time:153.967ms/image | min_time:152.562ms/image | avg_time:153.01ms/image | top5:0.934211 | top1:0.730263 |
| resnet50 | caffe | ubuntu16_04 | gcc8.3 | 990 | A76 | fp16 | cpu | 1 | 1/3/224/224 | max_time:76.0752ms/image | min_time:75.5671ms/image | avg_time:75.844ms/image | top5:0.934211 | top1:0.730263 |
| resnet50 | caffe | ubuntu16_04 | llvm | 990 | A55 | fp32 | cpu | 1 | 1/3/224/224 | max_time:956.05ms/image | min_time:669.802ms/image | avg_time:692.174ms/image | top5:0.934211 | top1:0.730263 |
| resnet50 | caffe | ubuntu16_04 | llvm | 990 | A55 | fp16 | cpu | 1 | 1/3/224/224 | max_time:308.14ms/image | min_time:283.158ms/image | avg_time:287.35ms/image | top5:0.934211 | top1:0.730263 |
| resnet50 | caffe | ubuntu16_04 | llvm | 990 | A76 | fp32 | cpu | 1 | 1/3/224/224 | max_time:157.702ms/image | min_time:154.775ms/image | avg_time:155.15ms/image | top5:0.934211 | top1:0.730263 |
| resnet50 | caffe | ubuntu16_04 | llvm | 990 | A76 | fp16 | cpu | 1 | 1/3/224/224 | max_time:79.03ms/image | min_time:77.3899ms/image | avg_time:77.7673ms/image | top5:0.934211 | top1:0.730263 |
| birealnet18 | onnx | ubuntu16_04 | gcc8.3 | 810 | A55 | binary | cpu | 1 | 1/3/224/224 | max_time:103.304ms/image | min_time:86.573ms/image | avg_time:88.4649ms/image | top5:0.782895 | top1:0.460526 |
| birealnet18 | onnx | ubuntu16_04 | gcc8.3 | 810 | A76 | binary | cpu | 1 | 1/3/224/224 | max_time:32.9131ms/image | min_time:30.6541ms/image | avg_time:32.1737ms/image | top5:0.782895 | top1:0.460526 |
| birealnet18 | onnx | ubuntu16_04 | gcc8.3 | 990 | A55 | binary | cpu | 1 | 1/3/224/224 | max_time:99.9858ms/image | min_time:82.6409ms/image | avg_time:85.7396ms/image | top5:0.782895 | top1:0.460526 |
| birealnet18 | onnx | ubuntu16_04 | gcc8.3 | 990 | A76 | binary | cpu | 1 | 1/3/224/224 | max_time:25.5642ms/image | min_time:23.6038ms/image | avg_time:24.7936ms/image | top5:0.782895 | top1:0.460526 |
| birealnet18 | onnx | ubuntu16_04 | llvm | 810 | A55 | binary | cpu | 1 | 1/3/224/224 | max_time:89.7971ms/image | min_time:77.2161ms/image | avg_time:78.3607ms/image | top5:0.782895 | top1:0.473684 |
| birealnet18 | onnx | ubuntu16_04 | llvm | 810 | A76 | binary | cpu | 1 | 1/3/224/224 | max_time:27.375ms/image | min_time:25.1851ms/image | avg_time:25.892ms/image | top5:0.782895 | top1:0.473684 |
| birealnet18 | onnx | ubuntu16_04 | llvm | 990 | A55 | binary | cpu | 1 | 1/3/224/224 | max_time:86.949ms/image | min_time:73.6069ms/image | avg_time:75.5283ms/image | top5:0.782895 | top1:0.473684 |
| birealnet18 | onnx | ubuntu16_04 | llvm | 990 | A76 | binary | cpu | 1 | 1/3/224/224 | max_time:20.3091ms/image | min_time:19.636ms/image | avg_time:19.7468ms/image | top5:0.782895 | top1:0.473684 |
| mobilenet_v1 | caffe | ubuntu16_04 | llvm | 990 | MALI-G76-MP16 | fp16 | gpu | 1 | 1/3/224/224 | max_time:11.2231ms/image | min_time:7.74097ms/image | avg_time:8.5096ms/image | top5:0.894737 | top1:0.644737 |
| mobilenet_v2 | caffe | ubuntu16_04 | llvm | 990 | MALI-G76-MP16 | fp16 | gpu | 1 | 1/3/224/224 | max_time:13.521ms/image | min_time:8.36597ms/image | avg_time:9.10277ms/image | top5:0.940789 | top1:0.756579 |
| mobilenet_v3 | caffe | ubuntu16_04 | llvm | 990 | MALI-G76-MP16 | fp16 | gpu | 1 | 1/3/224/224 | max_time:12.2771ms/image | min_time:5.12305ms/image | avg_time:7.50856ms/image | top5:0.671053 | top1:0.342105 |
| squeezenet | caffe | ubuntu16_04 | llvm | 990 | MALI-G76-MP16 | fp16 | gpu | 1 | 1/3/224/224 | max_time:11.2141ms/image | min_time:6.36304ms/image | avg_time:7.38169ms/image | top5:0.875 | top1:0.618421 |
| ghostnet | onnx | ubuntu16_04 | llvm | 990 | MALI-G76-MP16 | fp16 | gpu | 1 | 1/3/224/224 | max_time:15.1619ms/image | min_time:8.94604ms/image | avg_time:11.566ms/image | top5:0.973684 | top1:0.868421 |
| mobilenet_v1 | caffe | ubuntu16_04 | llvm | 810 | MALI-G52-MP6 | fp16 | gpu | 1 | 1/3/224/224 | max_time:16.575ms/image | min_time:11.979ms/image | avg_time:13.0283ms/image | top5:0.894737 | top1:0.644737 |
| mobilenet_v2 | caffe | ubuntu16_04 | llvm | 810 | MALI-G52-MP6 | fp16 | gpu | 1 | 1/3/224/224 | max_time:17.498ms/image | min_time:13.28ms/image | avg_time:14.2388ms/image | top5:0.940789 | top1:0.756579 |
| mobilenet_v3 | caffe | ubuntu16_04 | llvm | 810 | MALI-G52-MP6 | fp16 | gpu | 1 | 1/3/224/224 | max_time:12.8831ms/image | min_time:7.37183ms/image | avg_time:9.25686ms/image | top5:0.671053 | top1:0.342105 |
| squeezenet | caffe | ubuntu16_04 | llvm | 810 | MALI-G52-MP6 | fp16 | gpu | 1 | 1/3/224/224 | max_time:14.5859ms/image | min_time:9.90796ms/image | avg_time:10.5907ms/image | top5:0.875 | top1:0.618421 |
| ghostnet | onnx | ubuntu16_04 | llvm | 810 | MALI-G52-MP6 | fp16 | gpu | 1 | 1/3/224/224 | max_time:15.1641ms/image | min_time:12.0188ms/image | avg_time:13.2528ms/image | top5:0.973684 | top1:0.868421 |