12. Datasheet (TIOVX Apps)¶
The performance measurements includes the following,
FPS : Effective framerate at which the application runs
Total time : Average time taken to process each frame, which includes pre-processing, inference and post-processing time
Inference time : Average time taken to infer each frame
CPU loading : Loading on different CPU cores present
DDR BW : DDR read and write BW used
HWA Loading : Loading on different Hardware accelerators present
Following are the latest performance numbers of the edgeai-tiovx-apps:
12.1. Source : Video¶
Model |
FPS |
Total time (ms) |
Inference time (ms) |
A53 Load (%) |
DDR Read BW (MB/s) |
DDR Write BW (MB/s) |
DDR Total BW (MB/s) |
C7x Load (%) |
MSC_0 (%) |
MSC_1 (%) |
VISS (%) |
---|---|---|---|---|---|---|---|---|---|---|---|
ONR-CL-6360-regNetx-200mf |
40 |
23.73 |
4.64 |
35.94 |
1275 |
758 |
2033 |
28.45 |
55.98 |
26.19 |
0 |
ONR-OD-8200-yolox-nano-lite-mmdet-coco-416x416 |
30 |
32.25 |
9.03 |
30.02 |
1236 |
582 |
1818 |
43.53 |
41.71 |
18.55 |
0 |
TFL-CL-0000-mobileNetV1-mlperf |
40 |
29.50 |
4.36 |
29.95 |
880 |
403 |
1283 |
17.53 |
33.11 |
17.53 |
0 |
TFL-OD-2020-ssdLite-mobDet-DSP-coco-320x320 |
30 |
40.06 |
16.96 |
21.30 |
2227 |
431 |
2658 |
51.96 |
27.66 |
12.26 |
0 |
12.2. Source : CSI Camera with VISS (imx219)¶
Model |
FPS |
Total time (ms) |
Inference time (ms) |
A53 Load (%) |
DDR Read BW (MB/s) |
DDR Write BW (MB/s) |
DDR Total BW (MB/s) |
C7x Load (%) |
MSC_0 (%) |
MSC_1 (%) |
VISS (%) |
---|---|---|---|---|---|---|---|---|---|---|---|
ONR-CL-6360-regNetx-200mf |
20 |
37.43 |
4.57 |
14.64 |
535 |
233 |
768 |
9.18 |
24.70 |
8.75 |
11.81 |
ONR-OD-8200-yolox-nano-lite-mmdet-coco-416x416 |
20 |
38.38 |
8.89 |
11.32 |
568 |
231 |
799 |
9.7 |
20.25 |
7.87 |
11.70 |
TFL-CL-0000-mobileNetV1-mlperf |
20 |
38.3 |
4.33 |
13.96 |
570 |
235 |
805 |
8.71 |
24.64 |
8.72 |
11.81 |
TFL-OD-2020-ssdLite-mobDet-DSP-coco-320x320 |
20 |
39.78 |
16.51 |
10.09 |
1220 |
243 |
1463 |
24.97 |
18.95 |
7.06 |
11.13 |