Datasheet¶
Performance data of the demos can be auto generated by running following command on target:
root@tda4vm-sk:/opt/edge_ai_apps/tests# ./gen_data_sheet.sh
The performance measurements includes the following,
FPS : Effective framerate at which the application runs
Total time : Average time taken to process each frame, which includes pre-processing, inference and post-processing time
Inference time : Average time taken to infer each frame
CPU loading : Loading on different CPU cores present
DDR BW : DDR read and write BW used
HWA Loading : Loading on different Hardware accelerators present
Following are the latest performance numbers of the C++ demos:
Source : USB Camera¶
Capture Framerate : 30 fps Resolution : 720p format : JPEG
Fig. 30 GStreamer based data-flow pipeline with USB camera input and display output¶
Model |
FPS |
Total time (ms) |
Inference time (ms) |
A72 Load (%) |
DDR Read BW (MB/s) |
DDR Write BW (MB/s) |
DDR Total BW (MB/s) |
C71 Load (%) |
C66_1 Load (%) |
C66_2 Load (%) |
MCU2_0 Load (%) |
MCU2_1 Load (%) |
MSC_0 (%) |
MSC_1 (%) |
VISS (%) |
NF (%) |
LDC (%) |
SDE (%) |
DOF (%) |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
ONR-CL-6360-regNetx-200mf |
30.83 |
33.31 |
2.02 |
22.68 |
1470 |
534 |
2004 |
6.0 |
21.0 |
9.0 |
4.0 |
1.0 |
6.67 |
6.70 |
0 |
0 |
0 |
0 |
0 |
ONR-OD-8220-yolox-s-lite-mmdet-coco-640x640 |
30.83 |
33.26 |
11.50 |
24.18 |
1796 |
689 |
2485 |
33.0 |
76.0 |
9.0 |
4.0 |
1.0 |
7.19 |
6.79 |
0 |
0 |
0 |
0 |
0 |
TFL-CL-0000-mobileNetV1-mlperf |
30.84 |
33.24 |
1.04 |
36.20 |
1426 |
529 |
1955 |
5.0 |
22.0 |
9.0 |
4.0 |
1.0 |
6.78 |
6.73 |
0 |
0 |
0 |
0 |
0 |
TFL-OD-2020-ssdLite-mobDet-DSP-coco-320x320 |
30.68 |
33.25 |
5.01 |
24.32 |
1510 |
523 |
2033 |
15.0 |
29.0 |
9.0 |
4.0 |
1.0 |
7.18 |
6.82 |
0 |
0 |
0 |
0 |
0 |
Source : Video¶
Video Framerate : 30 fps Resolution : 720p Encoding : h264
Fig. 31 GStreamer based data-flow pipeline with video file input source and display output¶
Model |
FPS |
Total time (ms) |
Inference time (ms) |
A72 Load (%) |
DDR Read BW (MB/s) |
DDR Write BW (MB/s) |
DDR Total BW (MB/s) |
C71 Load (%) |
C66_1 Load (%) |
C66_2 Load (%) |
MCU2_0 Load (%) |
MCU2_1 Load (%) |
MSC_0 (%) |
MSC_1 (%) |
VISS (%) |
NF (%) |
LDC (%) |
SDE (%) |
DOF (%) |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
ONR-CL-6360-regNetx-200mf |
30.50 |
33.09 |
2.14 |
42.2 |
1704 |
636 |
2340 |
8.0 |
22.0 |
9.0 |
4.0 |
1.0 |
6.75 |
6.75 |
0 |
0 |
0 |
0 |
0 |
ONR-OD-8220-yolox-s-lite-mmdet-coco-640x640 |
30.36 |
33.19 |
11.36 |
40.67 |
2033 |
790 |
2823 |
32.0 |
76.0 |
9.0 |
4.0 |
1.0 |
6.75 |
6.76 |
0 |
0 |
0 |
0 |
0 |
TFL-CL-0000-mobileNetV1-mlperf |
30.54 |
33.12 |
1.67 |
40.0 |
1675 |
636 |
2311 |
7.0 |
22.0 |
9.0 |
4.0 |
1.0 |
6.85 |
6.70 |
0 |
0 |
0 |
0 |
0 |
TFL-OD-2020-ssdLite-mobDet-DSP-coco-320x320 |
30.38 |
33.22 |
5.05 |
35.83 |
1725 |
615 |
2340 |
16.0 |
29.0 |
9.0 |
4.0 |
1.0 |
6.78 |
6.66 |
0 |
0 |
0 |
0 |
0 |
Source : CSI Camera (ov5640)¶
Capture Framerate : 30 fps Resolution : 720p format : YUYV
Fig. 32 GStreamer based data-flow pipeline for with CSI camera (OV5640) input and display output¶
Model |
FPS |
Total time (ms) |
Inference time (ms) |
A72 Load (%) |
DDR Read BW (MB/s) |
DDR Write BW (MB/s) |
DDR Total BW (MB/s) |
C71 Load (%) |
C66_1 Load (%) |
C66_2 Load (%) |
MCU2_0 Load (%) |
MCU2_1 Load (%) |
MSC_0 (%) |
MSC_1 (%) |
VISS (%) |
NF (%) |
LDC (%) |
SDE (%) |
DOF (%) |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
ONR-CL-6360-regNetx-200mf |
29.51 |
34.46 |
2.00 |
16.58 |
1539 |
612 |
2151 |
6.0 |
45.0 |
9.0 |
4.0 |
1.0 |
6.51 |
6.50 |
0 |
0 |
0 |
0 |
0 |
ONR-OD-8220-yolox-s-lite-mmdet-coco-640x640 |
29.32 |
34.22 |
11.00 |
12.71 |
1864 |
763 |
2627 |
31.0 |
100.0 |
9.0 |
4.0 |
1.0 |
6.57 |
6.48 |
0 |
0 |
0 |
||
TFL-CL-0000-mobileNetV1-mlperf |
29.43 |
34.20 |
1.01 |
13.68 |
1499 |
607 |
2106 |
5.0 |
47.0 |
9.0 |
4.0 |
1.0 |
6.53 |
6.39 |
0 |
0 |
0 |
0 |
0 |
TFL-OD-2020-ssdLite-mobDet-DSP-coco-320x320 |
29.61 |
34.13 |
5.00 |
11.19 |
1549 |
588 |
2137 |
15.0 |
53.0 |
9.0 |
4.0 |
1.0 |
6.46 |
6.49 |
0 |
0 |
0 |
0 |
Source : CSI Camera with VISS (imx219)¶
Capture Framerate : 30 fps Resolution : 1080p format : SRGGB8
Fig. 33 GStreamer based data-flow pipeline with IMX219 sensor, ISP and display¶
Model |
FPS |
Total time (ms) |
Inference time (ms) |
A72 Load (%) |
DDR Read BW (MB/s) |
DDR Write BW (MB/s) |
DDR Total BW (MB/s) |
C71 Load (%) |
C66_1 Load (%) |
C66_2 Load (%) |
MCU2_0 Load (%) |
MCU2_1 Load (%) |
MSC_0 (%) |
MSC_1 (%) |
VISS (%) |
NF (%) |
LDC (%) |
SDE (%) |
DOF (%) |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
ONR-CL-6360-regNetx-200mf |
30.89 |
33.07 |
2.00 |
15.63 |
1504 |
604 |
2108 |
6.0 |
17.0 |
9.0 |
8.0 |
1.0 |
14.15 |
8.18 |
9.95 |
0 |
0 |
0 |
0 |
ONR-OD-8220-yolox-s-lite-mmdet-coco-640x640 |
30.45 |
33.13 |
11.02 |
14.39 |
1822 |
756 |
2578 |
32.0 |
72.0 |
9.0 |
8.0 |
1.0 |
14.4 |
7.12 |
9.97 |
0 |
0 |
0 |
0 |
TFL-CL-0000-mobileNetV1-mlperf |
30.74 |
33.11 |
1.01 |
14.89 |
1464 |
603 |
2067 |
5.0 |
18.0 |
9.0 |
8.0 |
1.0 |
14.18 |
8.18 |
9.81 |
0 |
0 |
0 |
0 |
TFL-OD-2020-ssdLite-mobDet-DSP-coco-320x320 |
30.67 |
33.16 |
5.01 |
11.80 |
1553 |
594 |
2147 |
16.0 |
25.0 |
9.0 |
8.0 |
1.0 |
16.18 |
8.54 |
9.95 |
0 |
0 |
0 |
0 |
Source : IMX390 over FPD-Link¶
Capture Framerate : 30 fps Resolution : 1080p format : SRGGB12
Fig. 34 GStreamer based data-flow pipeline with IMX390 sensor, ISP, LDC and display¶
Model |
FPS |
Total time (ms) |
Inference time (ms) |
A72 Load (%) |
DDR Read BW (MB/s) |
DDR Write BW (MB/s) |
DDR Total BW (MB/s) |
C71 Load (%) |
C66_1 Load (%) |
C66_2 Load (%) |
MCU2_0 Load (%) |
MCU2_1 Load (%) |
MSC_0 (%) |
MSC_1 (%) |
VISS (%) |
NF (%) |
LDC (%) |
SDE (%) |
DOF (%) |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
ONR-CL-6360-regNetx-200mf |
30.54 |
33.14 |
2.05 |
18.51 |
1706 |
772 |
2478 |
7.0 |
17.0 |
9.0 |
9.0 |
1.0 |
14.16 |
8.51 |
10.9 |
0 |
9.13 |
0 |
0 |
ONR-OD-8220-yolox-s-lite-mmdet-coco-640x640 |
30.93 |
33.08 |
11.02 |
13.50 |
2001 |
916 |
2917 |
32.0 |
72.0 |
9.0 |
8.0 |
1.0 |
14.11 |
7.2 |
10.16 |
0 |
9.31 |
0 |
0 |
TFL-CL-0000-mobileNetV1-mlperf |
30.70 |
33.16 |
1.11 |
16.75 |
1670 |
770 |
2440 |
5.0 |
18.0 |
9.0 |
9.0 |
1.0 |
14.21 |
8.51 |
10.5 |
0 |
9.30 |
0 |
0 |
TFL-OD-2020-ssdLite-mobDet-DSP-coco-320x320 |
30.54 |
33.15 |
5.00 |
14.74 |
1733 |
753 |
2486 |
15.0 |
25.0 |
9.0 |
9.0 |
1.0 |
14.8 |
8.34 |
10.18 |
0 |
9.8 |
0 |
0 |