12. Datasheet (TIOVX Apps)¶
The performance measurements includes the following,
FPS : Effective framerate at which the application runs
Total time : Average time taken to process each frame, which includes pre-processing, inference and post-processing time
Inference time : Average time taken to infer each frame
CPU loading : Loading on different CPU cores present
DDR BW : DDR read and write BW used
HWA Loading : Loading on different Hardware accelerators present
Following are the latest performance numbers of the edgeai-tiovx-apps:
12.1. Source : Video¶
Model Name |
MPU Load (%) |
C7x_0 Load (%) |
MSC0 Load (%) |
MSC1 Load (%) |
DDR Read BW (MB/s) |
DDR Write BW (MB/s) |
DDR Total BW (MB/s) |
FPS |
Inference time (ms) |
|---|---|---|---|---|---|---|---|---|---|
ONR-OD-8200-yolox-nano-lite-mmdet-coco-416x416 |
8.95 |
25.00 |
40.71 |
15.04 |
1107 |
653 |
1760 |
60 |
3.970 |
TFL-OD-2020-ssdLite-mobDet-DSP-coco-320x320 |
7.07 |
33.00 |
40.69 |
15.04 |
1192 |
629 |
1821 |
60 |
5.398 |
ONR-CL-6360-regNetx-200mf |
7.03 |
16.00 |
40.75 |
17.74 |
1074 |
624 |
1698 |
60 |
2.499 |
TFL-CL-0000-mobileNetV1-mlperf |
8.50 |
10.00 |
40.64 |
17.75 |
979 |
637 |
1616 |
60 |
1.600 |
12.2. Source : CSI Camera with VISS (imx219)¶
Model Name |
MPU Load (%) |
C7x_0 Load (%) |
VISS Load (%) |
MSC0 Load (%) |
MSC1 Load (%) |
DDR Read BW (MB/s) |
DDR Write BW (MB/s) |
DDR Total BW (MB/s) |
FPS |
Inference time (ms) |
|---|---|---|---|---|---|---|---|---|---|---|
ONR-OD-8200-yolox-nano-lite-mmdet-coco-416x416 |
2.46 |
13.00 |
9.49 |
23.49 |
9.26 |
654 |
374 |
1028 |
30 |
3.955 |
TFL-OD-2020-ssdLite-mobDet-DSP-coco-320x320 |
3.41 |
17.00 |
9.49 |
23.48 |
8.95 |
694 |
361 |
1055 |
30 |
5.382 |
ONR-CL-6360-regNetx-200mf |
3.39 |
8.00 |
9.49 |
23.48 |
8.58 |
628 |
353 |
981 |
30 |
2.494 |
TFL-CL-0000-mobileNetV1-mlperf |
3.88 |
5.00 |
9.49 |
23.53 |
8.59 |
588 |
356 |
944 |
30 |
1.605 |