11. Datasheet¶
The performance measurements includes the following,
FPS : Effective framerate at which the application runs
Total time : Average time taken to process each frame, which includes pre-processing, inference and post-processing time
Inference time : Average time taken to infer each frame
CPU loading : Loading on different CPU cores present
DDR BW : DDR read and write BW used
HWA Loading : Loading on different Hardware accelerators present
Following are the latest performance numbers of the OpTIFlow demos:
11.1. Source : Video¶
Fig. 11.1 GStreamer based data-flow pipeline with video file input source and display output¶
Model |
FPS |
Total time (ms) |
Inference time (ms) |
A72 Load (%) |
DDR Read BW (MB/s) |
DDR Write BW (MB/s) |
DDR Total BW (MB/s) |
C7x Load (%) |
C66_1 Load (%) |
C66_2 Load (%) |
MSC_0 (%) |
MSC_1 (%) |
VISS (%) |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
ONR-CL-6360-regNetx-200mf |
30 |
33 |
3.04 |
12.37 |
1182 |
235 |
1417 |
8.0 |
0 |
0 |
7.40 |
8.03 |
0 |
ONR-OD-8200-yolox-nano-lite-mmdet-coco-416x416 |
30 |
33 |
5.03 |
12.31 |
1209 |
245 |
1454 |
13.0 |
0 |
0 |
7.43 |
6.93 |
0 |
TFL-CL-0000-mobileNetV1-mlperf |
30 |
33 |
2.03 |
13.27 |
1126 |
231 |
1357 |
5.0 |
0 |
0 |
7.40 |
8.03 |
0 |
TFL-OD-2020-ssdLite-mobDet-DSP-coco-320x320 |
30 |
33 |
5.9 |
12.62 |
1215 |
229 |
1444 |
17.0 |
0 |
0 |
7.42 |
6.94 |
0 |
11.2. Source : USB Camera¶
Fig. 11.2 GStreamer based data-flow pipeline with USB camera input and display output¶
Model |
FPS |
Total time (ms) |
Inference time (ms) |
A72 Load (%) |
DDR Read BW (MB/s) |
DDR Write BW (MB/s) |
DDR Total BW (MB/s) |
C7x Load (%) |
C66_1 Load (%) |
C66_2 Load (%) |
MSC_0 (%) |
MSC_1 (%) |
VISS (%) |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
ONR-CL-6360-regNetx-200mf |
30 |
33 |
3.04 |
19.17 |
1168 |
246 |
1414 |
8.0 |
0 |
0 |
6.77 |
7.68 |
0 |
ONR-OD-8200-yolox-nano-lite-mmdet-coco-416x416 |
30 |
33 |
5.03 |
17.61 |
1185 |
264 |
1449 |
12.0 |
0 |
0 |
6.8 |
6.63 |
0 |
TFL-CL-0000-mobileNetV1-mlperf |
30 |
33 |
2.03 |
17.89 |
1107 |
242 |
1349 |
5.0 |
0 |
0 |
6.76 |
7.68 |
0 |
TFL-OD-2020-ssdLite-mobDet-DSP-coco-320x320 |
30 |
33 |
5.9 |
19.19 |
1205 |
249 |
1454 |
16.0 |
0 |
0 |
6.83 |
6.64 |
0 |
11.3. Source : CSI Camera with VISS (imx219)¶
Fig. 11.3 GStreamer based data-flow pipeline with IMX219 sensor, ISP and display¶
Model |
FPS |
Total time (ms) |
Inference time (ms) |
A72 Load (%) |
DDR Read BW (MB/s) |
DDR Write BW (MB/s) |
DDR Total BW (MB/s) |
C7x Load (%) |
C66_1 Load (%) |
C66_2 Load (%) |
MSC_0 (%) |
MSC_1 (%) |
VISS (%) |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
ONR-CL-6360-regNetx-200mf |
30 |
33 |
3.04 |
9.5 |
1170 |
311 |
1481 |
8.0 |
0 |
0 |
14.46 |
8.10 |
9.86 |
ONR-OD-8200-yolox-nano-lite-mmdet-coco-416x416 |
30 |
33 |
5.03 |
9.00 |
1208 |
340 |
1548 |
12.0 |
0 |
0 |
14.21 |
8.48 |
10.01 |
TFL-CL-0000-mobileNetV1-mlperf |
30 |
33 |
2.03 |
9.95 |
1116 |
309 |
1425 |
5.0 |
0 |
0 |
14.34 |
8.27 |
10.15 |
TFL-OD-2020-ssdLite-mobDet-DSP-coco-320x320 |
30 |
33 |
5.9 |
9.90 |
1220 |
326 |
1546 |
16.0 |
0 |
0 |
14.34 |
8.37 |
10.12 |