12. Datasheet (TIOVX Apps)¶
The performance measurements includes the following,
FPS : Effective framerate at which the application runs
Total time : Average time taken to process each frame, which includes pre-processing, inference and post-processing time
Inference time : Average time taken to infer each frame
CPU loading : Loading on different CPU cores present
DDR BW : DDR read and write BW used
HWA Loading : Loading on different Hardware accelerators present
Following are the latest performance numbers of the edgeai-tiovx-apps:
12.1. Source : Video¶
Model Name |
MPU Load (%) |
C7x_0 Load (%) |
MSC0 Load (%) |
MSC1 Load (%) |
DDR Read BW (MB/s) |
DDR Write BW (MB/s) |
DDR Total BW (MB/s) |
FPS |
Inference time (ms) |
|
|---|---|---|---|---|---|---|---|---|---|---|
ONR-OD-8200-yolox-nano-lite-mmdet-coco-416x416 |
9.82 |
54.55 |
52.47 |
24.12 |
1546 |
743 |
2289 |
60 |
8.985 |
|
TFL-OD-2020-ssdLite-mobDet-DSP-coco-320x320 |
7.28 |
82.35 |
49.82 |
23.77 |
1566 |
757 |
2323 |
60 |
13.618 |
|
ONR-CL-6360-regNetx-200mf |
5.65 |
29.29 |
65.78 |
26.15 |
1081 |
592 |
1673 |
60 |
4.788 |
|
TFL-CL-0000-mobileNetV1-mlperf |
8.58 |
26.08 |
65.46 |
26.14 |
1050 |
605 |
1655 |
60 |
4.251 |
12.2. Source : CSI Camera with VISS (imx219)¶
Model Name |
MPU Load (%) |
C7x_0 Load (%) |
VISS Load (%) |
MSC0 Load (%) |
MSC1 Load (%) |
DDR Read BW (MB/s) |
DDR Write BW (MB/s) |
DDR Total BW (MB/s) |
FPS |
Inference time (ms) |
|
|---|---|---|---|---|---|---|---|---|---|---|---|
ONR-OD-8200-yolox-nano-lite-mmdet-coco-416x416 |
3.20 |
27.01 |
17.32 |
38.67 |
14.86 |
934 |
436 |
1370 |
30 |
8.895 |
|
TFL-OD-2020-ssdLite-mobDet-DSP-coco-320x320 |
4.12 |
40.69 |
17.31 |
38.65 |
14.25 |
946 |
442 |
1388 |
30 |
13.434 |
|
ONR-CL-6360-regNetx-200mf |
4.34 |
14.70 |
17.32 |
38.62 |
13.53 |
697 |
354 |
1051 |
30 |
4.803 |
|
TFL-CL-0000-mobileNetV1-mlperf |
4.12 |
13.10 |
17.32 |
38.63 |
13.54 |
678 |
359 |
1037 |
30 |
4.269 |