10. Datasheet¶
Performance data of the demos can be auto generated by running following command on target:
/opt/edgeai-gst-apps/tests# ./gen_data_sheet.sh
The performance measurements includes the following,
FPS : Effective framerate at which the application runs
Total time : Average time taken to process each frame, which includes pre-processing, inference and post-processing time
Inference time : Average time taken to infer each frame
CPU loading : Loading on different CPU cores present
DDR BW : DDR read and write BW used
HWA Loading : Loading on different Hardware accelerators present
Following are the latest performance numbers of the C++ demos:
10.1. Source : Video¶
Video Framerate : 30 fps Resolution : 720p Encoding : h264
Fig. 10.1 GStreamer based data-flow pipeline with video file input source and display output¶
Model |
FPS |
Total time(ms) |
Inference time(ms) |
A72 Load(%) |
DDR Read BW(MB/s) |
DDR Write B/W(MB/s) |
C7x Load (%) |
MSC_0 (%) |
MSC_1 (%) |
VISS(%) |
|---|---|---|---|---|---|---|---|---|---|---|
ONR-CL-6360-regNetx-200mf |
30 |
33.33 |
2 |
40 |
864 |
318 |
6 |
6 |
6 |
0 |
TFL-CL-0000-mobileNetV1-mlperf |
30 |
33.33 |
1 |
40 |
871 |
314 |
4 |
6 |
6 |
0 |
ONR-OD-8200-yolox-nano-lite-mmdet-coco-416x416 |
30 |
33.33 |
5 |
38 |
890 |
320 |
12 |
6 |
6 |
0 |
TFL-OD-2010-ssd-mobV2-coco-mlperf-300x300 |
30 |
33.33 |
7 |
35 |
1540 |
318 |
19 |
6 |
9 |
0 |
10.2. Source : USB Camera¶
Capture Framerate : 30 fps Resolution : 720p format : JPEG
Fig. 10.2 GStreamer based data-flow pipeline with USB camera input and display output¶
Model |
FPS |
Total time(ms) |
Inference time(ms) |
A72 Load(%) |
DDR Read BW(MB/s) |
DDR Write B/W(MB/s) |
C7x Load (%) |
MSC_0 (%) |
MSC_1 (%) |
VISS(%) |
|---|---|---|---|---|---|---|---|---|---|---|
ONR-CL-6360-regNetx-200mf |
30 |
33.33 |
2 |
20 |
670 |
270 |
6 |
6 |
6 |
0 |
TFL-CL-0000-mobileNetV1-mlperf |
30 |
33.33 |
1 |
25 |
674 |
266 |
4 |
6 |
6 |
0 |
ONR-OD-8200-yolox-nano-lite-mmdet-coco-416x416 |
30 |
33.33 |
5 |
21 |
709 |
282 |
11 |
6 |
6 |
0 |
TFL-OD-2010-ssd-mobV2-coco-mlperf-300x300 |
30 |
33.33 |
7 |
20 |
1350 |
278 |
18 |
6 |
9 |
0 |
10.3. Source : CSI Camera with VISS (imx219)¶
Capture Framerate : 30 fps Resolution : 1080p format : SRGGB8
Fig. 10.3 GStreamer based data-flow pipeline with IMX219 sensor, ISP and display¶
Model |
FPS |
Total time(ms) |
Inference time(ms) |
A72 Load(%) |
DDR Read BW(MB/s) |
DDR Write B/W(MB/s) |
C7x Load (%) |
MSC_0 (%) |
MSC_1 (%) |
VISS(%) |
|---|---|---|---|---|---|---|---|---|---|---|
ONR-CL-6360-regNetx-200mf |
30 |
33.33 |
2 |
40 |
864 |
318 |
6 |
6 |
6 |
0 |
TFL-CL-0000-mobileNetV1-mlperf |
30 |
33.33 |
1 |
40 |
871 |
314 |
4 |
6 |
6 |
0 |
ONR-OD-8200-yolox-nano-lite-mmdet-coco-416x416 |
30 |
33.33 |
5 |
38 |
890 |
320 |
12 |
6 |
6 |
0 |
TFL-OD-2010-ssd-mobV2-coco-mlperf-300x300 |
30 |
33.33 |
7 |
35 |
1540 |
318 |
19 |
6 |
9 |
0 |