12. Datasheet (TIOVX Apps)¶
The performance measurements includes the following,
FPS : Effective framerate at which the application runs
Total time : Average time taken to process each frame, which includes pre-processing, inference and post-processing time
Inference time : Average time taken to infer each frame
CPU loading : Loading on different CPU cores present
DDR BW : DDR read and write BW used
HWA Loading : Loading on different Hardware accelerators present
Following are the latest performance numbers of the edgeai-tiovx-apps:
12.1. Source : Video¶
Model Name |
MPU Load (%) |
C7x_0 Load (%) |
MSC0 Load (%) |
MSC1 Load (%) |
DDR Read BW (MB/s) |
DDR Write BW (MB/s) |
DDR Total BW (MB/s) |
FPS |
Inference time (ms) |
|---|---|---|---|---|---|---|---|---|---|
ONR-OD-8200-yolox-nano-lite-mmdet-coco-416x416 |
8.91 |
24.00 |
37.96 |
14.20 |
1074 |
649 |
1723 |
60 |
3.815 |
TFL-OD-2020-ssdLite-mobDet-DSP-coco-320x320 |
8.08 |
32.00 |
38.04 |
14.22 |
1165 |
628 |
1793 |
60 |
5.224 |
ONR-CL-6360-regNetx-200mf |
6.96 |
15.00 |
38.07 |
16.39 |
1052 |
623 |
1675 |
60 |
2.391 |
TFL-CL-0000-mobileNetV1-mlperf |
10.00 |
10.00 |
37.91 |
16.39 |
973 |
638 |
1611 |
60 |
1.525 |
12.2. Source : CSI Camera with VISS (imx219)¶
Model Name |
MPU Load (%) |
C7x_0 Load (%) |
VISS Load (%) |
MSC0 Load (%) |
MSC1 Load (%) |
DDR Read BW (MB/s) |
DDR Write BW (MB/s) |
DDR Total BW (MB/s) |
FPS |
Inference time (ms) |
|---|---|---|---|---|---|---|---|---|---|---|
ONR-OD-8200-yolox-nano-lite-mmdet-coco-416x416 |
2.46 |
12.00 |
9.35 |
22.45 |
8.77 |
644 |
373 |
1017 |
30 |
3.780 |
TFL-OD-2020-ssdLite-mobDet-DSP-coco-320x320 |
1.97 |
16.00 |
9.35 |
22.50 |
8.45 |
683 |
361 |
1044 |
30 |
5.214 |
ONR-CL-6360-regNetx-200mf |
4.32 |
8.00 |
9.35 |
22.42 |
8.07 |
620 |
353 |
973 |
30 |
2.397 |
TFL-CL-0000-mobileNetV1-mlperf |
2.45 |
5.00 |
9.35 |
22.46 |
8.08 |
577 |
354 |
931 |
30 |
1.528 |