11. Datasheet¶
Performance data of the demos can be auto generated by running following command on target:
/opt/edgeai-gst-apps/tests# ./gen_data_sheet.sh
The performance measurements includes the following,
FPS : Effective framerate at which the application runs
Total time : Average time taken to process each frame, which includes pre-processing, inference and post-processing time
Inference time : Average time taken to infer each frame
CPU loading : Loading on different CPU cores present
DDR BW : DDR read and write BW used
HWA Loading : Loading on different Hardware accelerators present
Following are the latest performance numbers of the C++ demos:
11.1. Source : Video¶
Video Framerate : 30 fps Resolution : 720p Encoding : h264
Fig. 11.1 GStreamer based data-flow pipeline with video file input source and display output¶
Model |
FPS |
Total time (ms) |
Inference time (ms) |
A72 Load (%) |
DDR Read BW (MB/s) |
DDR Write BW (MB/s) |
DDR Total BW (MB/s) |
C71 Load (%) |
C66_1 Load (%) |
C66_2 Load (%) |
MCU2_0 Load (%) |
MCU2_1 Load (%) |
MSC_0 (%) |
MSC_1 (%) |
VISS (%) |
NF (%) |
LDC (%) |
SDE (%) |
DOF (%) |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
ONR-CL-6360-regNetx-200mf |
30.50 |
33.09 |
2.14 |
42.2 |
1704 |
636 |
2340 |
8.0 |
22.0 |
9.0 |
4.0 |
1.0 |
6.75 |
6.75 |
0 |
0 |
0 |
0 |
0 |
ONR-OD-8220-yolox-s-lite-mmdet-coco-640x640 |
30.36 |
33.19 |
11.36 |
40.67 |
2033 |
790 |
2823 |
32.0 |
76.0 |
9.0 |
4.0 |
1.0 |
6.75 |
6.76 |
0 |
0 |
0 |
0 |
0 |
TFL-CL-0000-mobileNetV1-mlperf |
30.54 |
33.12 |
1.67 |
40.0 |
1675 |
636 |
2311 |
7.0 |
22.0 |
9.0 |
4.0 |
1.0 |
6.85 |
6.70 |
0 |
0 |
0 |
0 |
0 |
TFL-OD-2020-ssdLite-mobDet-DSP-coco-320x320 |
30.38 |
33.22 |
5.05 |
35.83 |
1725 |
615 |
2340 |
16.0 |
29.0 |
9.0 |
4.0 |
1.0 |
6.78 |
6.66 |
0 |
0 |
0 |
0 |
0 |
11.2. Source : USB Camera¶
Capture Framerate : 30 fps Resolution : 720p format : JPEG
Fig. 11.2 GStreamer based data-flow pipeline with USB camera input and display output¶
Model |
FPS |
Total time (ms) |
Inference time (ms) |
A72 Load (%) |
DDR Read BW (MB/s) |
DDR Write BW (MB/s) |
DDR Total BW (MB/s) |
C71 Load (%) |
C66_1 Load (%) |
C66_2 Load (%) |
MCU2_0 Load (%) |
MCU2_1 Load (%) |
MSC_0 (%) |
MSC_1 (%) |
VISS (%) |
NF (%) |
LDC (%) |
SDE (%) |
DOF (%) |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
ONR-CL-6360-regNetx-200mf |
30.83 |
33.31 |
2.02 |
22.68 |
1470 |
534 |
2004 |
6.0 |
21.0 |
9.0 |
4.0 |
1.0 |
6.67 |
6.70 |
0 |
0 |
0 |
0 |
0 |
ONR-OD-8220-yolox-s-lite-mmdet-coco-640x640 |
30.83 |
33.26 |
11.50 |
24.18 |
1796 |
689 |
2485 |
33.0 |
76.0 |
9.0 |
4.0 |
1.0 |
7.19 |
6.79 |
0 |
0 |
0 |
0 |
0 |
TFL-CL-0000-mobileNetV1-mlperf |
30.84 |
33.24 |
1.04 |
36.20 |
1426 |
529 |
1955 |
5.0 |
22.0 |
9.0 |
4.0 |
1.0 |
6.78 |
6.73 |
0 |
0 |
0 |
0 |
0 |
TFL-OD-2020-ssdLite-mobDet-DSP-coco-320x320 |
30.68 |
33.25 |
5.01 |
24.32 |
1510 |
523 |
2033 |
15.0 |
29.0 |
9.0 |
4.0 |
1.0 |
7.18 |
6.82 |
0 |
0 |
0 |
0 |
0 |
11.3. Source : CSI Camera with VISS (imx219)¶
Capture Framerate : 30 fps Resolution : 1080p format : SRGGB8
Fig. 11.3 GStreamer based data-flow pipeline with IMX219 sensor, ISP and display¶
Model |
FPS |
Total time (ms) |
Inference time (ms) |
A72 Load (%) |
DDR Read BW (MB/s) |
DDR Write BW (MB/s) |
DDR Total BW (MB/s) |
C71 Load (%) |
C66_1 Load (%) |
C66_2 Load (%) |
MCU2_0 Load (%) |
MCU2_1 Load (%) |
MSC_0 (%) |
MSC_1 (%) |
VISS (%) |
NF (%) |
LDC (%) |
SDE (%) |
DOF (%) |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
ONR-CL-6360-regNetx-200mf |
30.89 |
33.07 |
2.00 |
15.63 |
1504 |
604 |
2108 |
6.0 |
17.0 |
9.0 |
8.0 |
1.0 |
14.15 |
8.18 |
9.95 |
0 |
0 |
0 |
0 |
ONR-OD-8220-yolox-s-lite-mmdet-coco-640x640 |
30.45 |
33.13 |
11.02 |
14.39 |
1822 |
756 |
2578 |
32.0 |
72.0 |
9.0 |
8.0 |
1.0 |
14.4 |
7.12 |
9.97 |
0 |
0 |
0 |
0 |
TFL-CL-0000-mobileNetV1-mlperf |
30.74 |
33.11 |
1.01 |
14.89 |
1464 |
603 |
2067 |
5.0 |
18.0 |
9.0 |
8.0 |
1.0 |
14.18 |
8.18 |
9.81 |
0 |
0 |
0 |
0 |
TFL-OD-2020-ssdLite-mobDet-DSP-coco-320x320 |
30.67 |
33.16 |
5.01 |
11.80 |
1553 |
594 |
2147 |
16.0 |
25.0 |
9.0 |
8.0 |
1.0 |
16.18 |
8.54 |
9.95 |
0 |
0 |
0 |
0 |