11. Datasheet¶
The performance measurements includes the following,
FPS : Effective framerate at which the application runs
Total time : Average time taken to process each frame, which includes pre-processing, inference and post-processing time
Inference time : Average time taken to infer each frame
CPU loading : Loading on different CPU cores present
DDR BW : DDR read and write BW used
HWA Loading : Loading on different Hardware accelerators present
Following are the latest performance numbers of the OpTIFlow demos:
11.1. Source : Video¶
Fig. 11.1 GStreamer based data-flow pipeline with video file input source and display output¶
Model |
FPS |
Total time (ms) |
Inference time (ms) |
A72 Load (%) |
DDR Read BW (MB/s) |
DDR Write BW (MB/s) |
DDR Total BW (MB/s) |
C7x Load (%) |
C66_1 Load (%) |
C66_2 Load (%) |
MSC_0 (%) |
MSC_1 (%) |
VISS (%) |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
ONR-CL-6360-regNetx-200mf |
30 |
33 |
3.06 |
12.69 |
1194 |
237 |
1431 |
8.0 |
0 |
0 |
7.20 |
7.75 |
0 |
ONR-OD-8200-yolox-nano-lite-mmdet-coco-416x416 |
30 |
33 |
5.07 |
13.0 |
1210 |
248 |
1458 |
13.0 |
0 |
0 |
7.21 |
6.76 |
0 |
TFL-CL-0000-mobileNetV1-mlperf |
30 |
33 |
2.03 |
12.18 |
1127 |
232 |
1359 |
5.0 |
0 |
0 |
7.21 |
7.76 |
0 |
TFL-OD-2020-ssdLite-mobDet-DSP-coco-320x320 |
30 |
33 |
6.0 |
13.79 |
1214 |
227 |
1441 |
17.0 |
0 |
0 |
7.20 |
6.76 |
0 |
11.2. Source : USB Camera¶
Fig. 11.2 GStreamer based data-flow pipeline with USB camera input and display output¶
Model |
FPS |
Total time (ms) |
Inference time (ms) |
A72 Load (%) |
DDR Read BW (MB/s) |
DDR Write BW (MB/s) |
DDR Total BW (MB/s) |
C7x Load (%) |
C66_1 Load (%) |
C66_2 Load (%) |
MSC_0 (%) |
MSC_1 (%) |
VISS (%) |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
ONR-CL-6360-regNetx-200mf |
30 |
33 |
3.06 |
22.44 |
1193 |
256 |
1449 |
8.0 |
0 |
0 |
6.81 |
7.74 |
0 |
ONR-OD-8200-yolox-nano-lite-mmdet-coco-416x416 |
30 |
33 |
5.07 |
24.62 |
1216 |
272 |
1488 |
13.0 |
0 |
0 |
7.04 |
6.82 |
0 |
TFL-CL-0000-mobileNetV1-mlperf |
30 |
33 |
2.03 |
22.44 |
1119 |
247 |
1366 |
5.0 |
0 |
0 |
7.30 |
7.81 |
0 |
TFL-OD-2020-ssdLite-mobDet-DSP-coco-320x320 |
30 |
33 |
6.0 |
17.09 |
1217 |
248 |
1465 |
17.0 |
0 |
0 |
6.89 |
6.81 |
0 |
11.3. Source : CSI Camera with VISS (imx219)¶
Fig. 11.3 GStreamer based data-flow pipeline with IMX219 sensor, ISP and display¶
Model |
FPS |
Total time (ms) |
Inference time (ms) |
A72 Load (%) |
DDR Read BW (MB/s) |
DDR Write BW (MB/s) |
DDR Total BW (MB/s) |
C7x Load (%) |
C66_1 Load (%) |
C66_2 Load (%) |
MSC_0 (%) |
MSC_1 (%) |
VISS (%) |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
ONR-CL-6360-regNetx-200mf |
30 |
33 |
3.06 |
13.50 |
1198 |
323 |
1521 |
9.0 |
0 |
0 |
14.24 |
8.10 |
10.04 |
ONR-OD-8200-yolox-nano-lite-mmdet-coco-416x416 |
30 |
33 |
5.07 |
10.20 |
1217 |
341 |
1558 |
13.0 |
0 |
0 |
14.24 |
8.86 |
10.05 |
TFL-CL-0000-mobileNetV1-mlperf |
30 |
33 |
2.03 |
13.79 |
1130 |
314 |
1444 |
6.0 |
0 |
0 |
14.23 |
8.09 |
10.04 |
TFL-OD-2020-ssdLite-mobDet-DSP-coco-320x320 |
30 |
33 |
6.0 |
10.50 |
1221 |
319 |
1540 |
17.0 |
0 |
0 |
14.24 |
8.49 |
10.03 |