11. Datasheet (Optiflow)¶
FPS : Effective framerate at which the application runs
Total time : Average time taken to process each frame, which includes pre-processing, inference and post-processing time
Inference time : Average time taken to infer each frame
CPU loading : Loading on different CPU cores present
DDR BW : DDR read and write BW used
HWA Loading : Loading on different Hardware accelerators present
Following are the latest performance numbers of the OpTIFlow demos:
11.1. Source : Video¶
Fig. 11.1 GStreamer based data-flow pipeline with video file input source and display output¶
Model Name |
MPU Load (%) |
MCU_2_0 Load (%) |
MCU_2_1 Load (%) |
MCU_3_0 Load (%) |
MCU_3_1 Load (%) |
MCU_4_0 Load (%) |
MCU_4_1 Load (%) |
C7x_1 Load (%) |
C7x_2 Load (%) |
C7x_3 Load (%) |
C7x_4 Load (%) |
VISS (%) |
LDC |
BLNF |
MSC_0 (%) |
MSC_1 (%) |
DOF |
SDE |
GPU |
VISS (%)_1 |
LDC_1 |
BLNF_1 |
MSC_0 (%)_1 |
MSC_1 (%)_1 |
VISS (%) |
LDC |
BLNF |
MSC_0 (%) |
MSC_1 (%) |
DOF |
SDE |
GPU |
VISS (%)_1 |
LDC_1 |
BLNF_1 |
MSC_0 (%)_1 |
MSC_1 (%)_1 |
VISS (%) |
LDC |
BLNF |
MSC_0 (%) |
MSC_1 (%) |
DOF |
SDE |
GPU |
VISS (%)_1 |
LDC_1 |
BLNF_1 |
MSC_0 (%)_1 |
MSC_1 (%)_1 |
VISS (%) |
LDC |
BLNF |
MSC_0 (%) |
MSC_1 (%) |
DOF |
SDE |
GPU |
VISS (%)_1 |
LDC_1 |
BLNF_1 |
MSC_0 (%)_1 |
MSC_1 (%)_1 |
DDR Read BW (MB/s) |
DDR Read Peak BW (MB/s) |
DDR Write BW (MB/s) |
DDR Write Peak BW (MB/s) |
DDR Total BW (MB/s) |
DDR Total Peak BW (MB/s) |
temp_thermal_zone0(MCU_R5F) |
temp_thermal_zone1(MCU) |
temp_thermal_zone2(GPU) |
temp_thermal_zone3(C7x) |
temp_thermal_zone4(CPU) |
temp_thermal_zone5(C7x) |
temp_thermal_zone6(DDR) |
FPS |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
ONR-CL-6360-regNetx-200mf |
4.35 |
5.00 |
0.00 |
1.00 |
1.00 |
2.00 |
1.00 |
10.00 |
0.00 |
0.00 |
1.00 |
0.00 |
0.00 |
0.00 |
5.01 |
6.50 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.73 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
1102 |
1102 |
233 |
233 |
1335 |
1335 |
46.79 |
46.79 |
45.66 |
45.89 |
46.12 |
44.98 |
49.27 |
30 |
ONR-OD-8200-yolox-nano-lite-mmdet-coco-416x416 |
3.98 |
4.00 |
1.00 |
1.00 |
1.00 |
1.00 |
1.00 |
13.00 |
1.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
5.01 |
6.50 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
1037 |
1037 |
239 |
239 |
1276 |
1276 |
46.12 |
45.66 |
44.98 |
45.66 |
44.98 |
43.84 |
48.60 |
30 |
TFL-CL-0000-mobileNetV1-mlperf |
4.72 |
5.00 |
1.00 |
1.00 |
1.00 |
2.00 |
1.00 |
5.00 |
0.00 |
0.00 |
1.00 |
0.00 |
0.00 |
0.00 |
5.02 |
6.50 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.72 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
1038 |
1038 |
230 |
230 |
1268 |
1268 |
47.02 |
46.79 |
46.79 |
47.02 |
47.02 |
44.75 |
49.94 |
30 |
TFL-OD-2020-ssdLite-mobDet-DSP-coco-320x320 |
3.87 |
4.00 |
1.00 |
1.00 |
1.00 |
1.00 |
1.00 |
16.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
5.01 |
6.51 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
1144 |
1144 |
221 |
221 |
1365 |
1365 |
46.57 |
46.79 |
45.66 |
45.89 |
45.44 |
44.07 |
49.04 |
30 |
11.2. Source : CSI Camera with VISS (imx219)¶
Fig. 11.2 GStreamer based data-flow pipeline with IMX219 sensor, ISP and display¶
Model Name |
MPU Load (%) |
MCU_2_0 Load (%) |
MCU_2_1 Load (%) |
MCU_3_0 Load (%) |
MCU_3_1 Load (%) |
MCU_4_0 Load (%) |
MCU_4_1 Load (%) |
C7x_1 Load (%) |
C7x_2 Load (%) |
C7x_3 Load (%) |
C7x_4 Load (%) |
VISS (%) |
LDC |
BLNF |
MSC_0 (%) |
MSC_1 (%) |
DOF |
SDE |
GPU |
VISS (%)_1 |
LDC_1 |
BLNF_1 |
MSC_0 (%)_1 |
MSC_1 (%)_1 |
VISS (%) |
LDC |
BLNF |
MSC_0 (%) |
MSC_1 (%) |
DOF |
SDE |
GPU |
VISS (%)_1 |
LDC_1 |
BLNF_1 |
MSC_0 (%)_1 |
MSC_1 (%)_1 |
VISS (%) |
LDC |
BLNF |
MSC_0 (%) |
MSC_1 (%) |
DOF |
SDE |
GPU |
VISS (%)_1 |
LDC_1 |
BLNF_1 |
MSC_0 (%)_1 |
MSC_1 (%)_1 |
VISS (%) |
LDC |
BLNF |
MSC_0 (%) |
MSC_1 (%) |
DOF |
SDE |
GPU |
VISS (%)_1 |
LDC_1 |
BLNF_1 |
MSC_0 (%)_1 |
MSC_1 (%)_1 |
DDR Read BW (MB/s) |
DDR Read Peak BW (MB/s) |
DDR Write BW (MB/s) |
DDR Write Peak BW (MB/s) |
DDR Total BW (MB/s) |
DDR Total Peak BW (MB/s) |
temp_thermal_zone0(MCU_R5F) |
temp_thermal_zone1(MCU) |
temp_thermal_zone2(GPU) |
temp_thermal_zone3(C7x) |
temp_thermal_zone4(CPU) |
temp_thermal_zone5(C7x) |
temp_thermal_zone6(DDR) |
FPS |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
ONR-CL-6360-regNetx-200mf |
3.62 |
8.00 |
1.00 |
0.00 |
1.00 |
1.00 |
1.00 |
10.00 |
0.00 |
0.00 |
0.00 |
9.48 |
0.00 |
0.00 |
9.76 |
6.57 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.86 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
1166 |
1166 |
317 |
317 |
1483 |
1483 |
47.70 |
47.25 |
46.12 |
47.92 |
47.25 |
45.21 |
50.16 |
30 |
ONR-OD-8200-yolox-nano-lite-mmdet-coco-416x416 |
3.12 |
8.00 |
0.00 |
1.00 |
1.00 |
2.00 |
1.00 |
13.00 |
1.00 |
0.00 |
0.00 |
9.49 |
0.00 |
0.00 |
9.78 |
6.58 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
1.36 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
1101 |
1101 |
340 |
340 |
1441 |
1441 |
47.25 |
47.47 |
45.89 |
47.25 |
46.57 |
44.98 |
49.71 |
30 |
TFL-CL-0000-mobileNetV1-mlperf |
3.37 |
8.00 |
1.00 |
0.00 |
1.00 |
1.00 |
0.00 |
5.00 |
0.00 |
0.00 |
0.00 |
9.47 |
0.00 |
0.00 |
9.76 |
6.57 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.86 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
1067 |
1067 |
310 |
310 |
1377 |
1377 |
48.15 |
47.70 |
46.12 |
47.92 |
46.79 |
45.44 |
49.49 |
30 |
TFL-OD-2020-ssdLite-mobDet-DSP-coco-320x320 |
3.26 |
8.00 |
1.00 |
0.00 |
1.00 |
1.00 |
1.00 |
16.00 |
0.00 |
0.00 |
0.00 |
9.44 |
0.00 |
0.00 |
9.75 |
6.57 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
1.10 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
1211 |
1211 |
318 |
318 |
1529 |
1529 |
47.47 |
47.25 |
46.57 |
47.25 |
46.79 |
45.21 |
49.27 |
30 |