9. Datasheet¶
Performance data of the demos can be auto generated by running following command on target:
/opt/edgeai-gst-apps/tests# ./gen_data_sheet.sh
The performance measurements includes the following,
FPS : Effective framerate at which the application runs
Total time : Average time taken to process each frame, which includes pre-processing, inference and post-processing time
Inference time : Average time taken to infer each frame
CPU loading : Loading on different CPU cores present
DDR BW : DDR read and write BW used
HWA Loading : Loading on different Hardware accelerators present
Following are the latest performance numbers of the C++ demos:
9.1. Source : Video¶
Video Framerate : 30 fps Resolution : 720p Encoding : h264
Fig. 9.1 GStreamer based data-flow pipeline with video file input source and display output¶
Model |
FPS |
Total time(ms) |
Inference time(ms) |
A72 Load(%) |
DDR Read BW(MB/s) |
DDR Write B/W(MB/s) |
C7x Load (%) |
MSC_0 (%) |
MSC_1 (%) |
VISS(%) |
|---|---|---|---|---|---|---|---|---|---|---|
ONR-CL-6360-regNetx-200mf |
30 |
33.33 |
4.07 |
20.73 |
946 |
349 |
11 |
12.01 |
12.04 |
0 |
TFL-CL-0000-mobileNetV1-mlperf |
30 |
33.33 |
3.25 |
21.25 |
1024 |
324 |
10 |
12.01 |
12.04 |
0 |
ONR-OD-8200-yolox-nano-lite-mmdet-coco-416x416 |
30 |
33.33 |
9.2 |
19.11 |
1152 |
443 |
25 |
12.01 |
12.03 |
0 |
TFL-OD-2010-ssd-mobV2-coco-mlperf-300x300 |
30 |
33.33 |
18.65 |
21.07 |
3061 |
453 |
50 |
12.02 |
17.31 |
0 |
9.2. Source : USB Camera¶
Capture Framerate : 30 fps Resolution : 720p format : JPEG
Fig. 9.2 GStreamer based data-flow pipeline with USB camera input and display output¶
Model |
FPS |
Total time(ms) |
Inference time(ms) |
A72 Load(%) |
DDR Read BW(MB/s) |
DDR Write B/W(MB/s) |
C7x Load (%) |
MSC_0 (%) |
MSC_1 (%) |
VISS(%) |
|---|---|---|---|---|---|---|---|---|---|---|
ONR-CL-6360-regNetx-200mf |
30 |
33.33 |
4.1 |
12.89 |
818 |
409 |
11 |
26.24 |
21.75 |
17.91 |
TFL-CL-0000-mobileNetV1-mlperf |
30 |
33.33 |
3.14 |
12.47 |
875 |
377 |
10 |
26.22 |
21.73 |
17.88 |
ONR-OD-8200-yolox-nano-lite-mmdet-coco-416x416 |
30 |
33.33 |
9.2 |
10.62 |
1010 |
503 |
25 |
26.35 |
22.79 |
17.39 |
TFL-OD-2010-ssd-mobV2-coco-mlperf-300x300 |
30 |
33.33 |
18.65 |
10.12 |
2888 |
487 |
50 |
26.16 |
21.4 |
17.73 |
9.3. Source : CSI Camera with VISS (imx219)¶
Capture Framerate : 30 fps Resolution : 1080p format : SRGGB8
Fig. 9.3 GStreamer based data-flow pipeline with IMX219 sensor, ISP and display¶
Model |
FPS |
Total time(ms) |
Inference time(ms) |
A72 Load(%) |
DDR Read BW(MB/s) |
DDR Write B/W(MB/s) |
C7x Load (%) |
MSC_0 (%) |
MSC_1 (%) |
VISS(%) |
|---|---|---|---|---|---|---|---|---|---|---|
ONR-CL-6360-regNetx-200mf |
30 |
33.33 |
4.1 |
12.89 |
818 |
409 |
11 |
26.24 |
21.75 |
17.91 |
TFL-CL-0000-mobileNetV1-mlperf |
30 |
33.33 |
3.14 |
12.47 |
875 |
377 |
10 |
26.22 |
21.73 |
17.88 |
ONR-OD-8200-yolox-nano-lite-mmdet-coco-416x416 |
30 |
33.33 |
9.2 |
10.62 |
1010 |
503 |
25 |
26.35 |
22.79 |
17.39 |
TFL-OD-2010-ssd-mobV2-coco-mlperf-300x300 |
30 |
33.33 |
18.65 |
10.12 |
2888 |
487 |
50 |
26.16 |
21.4 |
17.73 |