11. Datasheet (Optiflow)¶
FPS : Effective framerate at which the application runs
Total time : Average time taken to process each frame, which includes pre-processing, inference and post-processing time
Inference time : Average time taken to infer each frame
CPU loading : Loading on different CPU cores present
DDR BW : DDR read and write BW used
HWA Loading : Loading on different Hardware accelerators present
Following are the latest performance numbers of the OpTIFlow demos:
11.1. Source : Video¶
Fig. 11.1 GStreamer based data-flow pipeline with video file input source and display output¶
Model Name |
MPU Load (%) |
MCU_2_0 Load (%) |
MCU_2_1 Load (%) |
MCU_3_0 Load (%) |
MCU_3_1 Load (%) |
MCU_4_0 Load (%) |
MCU_4_1 Load (%) |
C7x_1 Load (%) |
C7x_2 Load (%) |
C7x_3 Load (%) |
C7x_4 Load (%) |
VISS (%) |
LDC |
BLNF |
MSC_0 (%) |
MSC_1 (%) |
DOF |
SDE |
GPU |
VISS (%)_1 |
LDC_1 |
BLNF_1 |
MSC_0 (%)_1 |
MSC_1 (%)_1 |
VISS (%) |
LDC |
BLNF |
MSC_0 (%) |
MSC_1 (%) |
DOF |
SDE |
GPU |
VISS (%)_1 |
LDC_1 |
BLNF_1 |
MSC_0 (%)_1 |
MSC_1 (%)_1 |
VISS (%) |
LDC |
BLNF |
MSC_0 (%) |
MSC_1 (%) |
DOF |
SDE |
GPU |
VISS (%)_1 |
LDC_1 |
BLNF_1 |
MSC_0 (%)_1 |
MSC_1 (%)_1 |
VISS (%) |
LDC |
BLNF |
MSC_0 (%) |
MSC_1 (%) |
DOF |
SDE |
GPU |
VISS (%)_1 |
LDC_1 |
BLNF_1 |
MSC_0 (%)_1 |
MSC_1 (%)_1 |
DDR Read BW (MB/s) |
DDR Read Peak BW (MB/s) |
DDR Write BW (MB/s) |
DDR Write Peak BW (MB/s) |
DDR Total BW (MB/s) |
DDR Total Peak BW (MB/s) |
temp_thermal_zone0(MCU_R5F) |
temp_thermal_zone1(MCU) |
temp_thermal_zone2(GPU) |
temp_thermal_zone3(C7x) |
temp_thermal_zone4(CPU) |
temp_thermal_zone5(C7x) |
temp_thermal_zone6(DDR) |
FPS |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
ONR-CL-6360-regNetx-200mf |
3.62 |
3.00 |
0.00 |
1.00 |
1.00 |
1.00 |
1.00 |
9.00 |
0.00 |
1.00 |
0.00 |
0.00 |
0.00 |
0.00 |
7.00 |
6.35 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.84 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
1077 |
1077 |
226 |
226 |
1303 |
1303 |
51.05 |
51.27 |
50.16 |
50.82 |
51.27 |
50.60 |
52.59 |
30 |
ONR-OD-8200-yolox-nano-lite-mmdet-coco-416x416 |
2.19 |
3.00 |
0.00 |
1.00 |
1.00 |
1.00 |
0.00 |
12.00 |
0.00 |
0.00 |
1.00 |
0.00 |
0.00 |
0.00 |
7.00 |
6.35 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
1009 |
1009 |
237 |
237 |
1246 |
1246 |
50.82 |
51.49 |
49.94 |
50.16 |
50.60 |
49.49 |
52.59 |
30 |
TFL-CL-0000-mobileNetV1-mlperf |
3.49 |
3.00 |
0.00 |
1.00 |
0.00 |
1.00 |
1.00 |
5.00 |
0.00 |
0.00 |
1.00 |
0.00 |
0.00 |
0.00 |
7.01 |
6.35 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.84 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
1005 |
1005 |
225 |
225 |
1230 |
1230 |
50.82 |
51.71 |
50.16 |
50.60 |
51.49 |
50.60 |
53.25 |
30 |
TFL-OD-2020-ssdLite-mobDet-DSP-coco-320x320 |
3.71 |
4.00 |
1.00 |
0.00 |
1.00 |
1.00 |
1.00 |
16.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
7.00 |
6.35 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
1146 |
1146 |
223 |
223 |
1369 |
1369 |
51.05 |
50.82 |
50.38 |
50.82 |
50.60 |
50.38 |
52.81 |
30 |
11.2. Source : CSI Camera with VISS (imx219)¶
Fig. 11.2 GStreamer based data-flow pipeline with IMX219 sensor, ISP and display¶
Model Name |
MPU Load (%) |
MCU_2_0 Load (%) |
MCU_2_1 Load (%) |
MCU_3_0 Load (%) |
MCU_3_1 Load (%) |
MCU_4_0 Load (%) |
MCU_4_1 Load (%) |
C7x_1 Load (%) |
C7x_2 Load (%) |
C7x_3 Load (%) |
C7x_4 Load (%) |
VISS (%) |
LDC |
BLNF |
MSC_0 (%) |
MSC_1 (%) |
DOF |
SDE |
GPU |
VISS (%)_1 |
LDC_1 |
BLNF_1 |
MSC_0 (%)_1 |
MSC_1 (%)_1 |
VISS (%) |
LDC |
BLNF |
MSC_0 (%) |
MSC_1 (%) |
DOF |
SDE |
GPU |
VISS (%)_1 |
LDC_1 |
BLNF_1 |
MSC_0 (%)_1 |
MSC_1 (%)_1 |
VISS (%) |
LDC |
BLNF |
MSC_0 (%) |
MSC_1 (%) |
DOF |
SDE |
GPU |
VISS (%)_1 |
LDC_1 |
BLNF_1 |
MSC_0 (%)_1 |
MSC_1 (%)_1 |
VISS (%) |
LDC |
BLNF |
MSC_0 (%) |
MSC_1 (%) |
DOF |
SDE |
GPU |
VISS (%)_1 |
LDC_1 |
BLNF_1 |
MSC_0 (%)_1 |
MSC_1 (%)_1 |
DDR Read BW (MB/s) |
DDR Read Peak BW (MB/s) |
DDR Write BW (MB/s) |
DDR Write Peak BW (MB/s) |
DDR Total BW (MB/s) |
DDR Total Peak BW (MB/s) |
temp_thermal_zone0(MCU_R5F) |
temp_thermal_zone1(MCU) |
temp_thermal_zone2(GPU) |
temp_thermal_zone3(C7x) |
temp_thermal_zone4(CPU) |
temp_thermal_zone5(C7x) |
temp_thermal_zone6(DDR) |
FPS |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
ONR-CL-6360-regNetx-200mf |
1.39 |
6.00 |
1.00 |
1.00 |
1.00 |
1.00 |
1.00 |
9.00 |
0.00 |
0.00 |
0.00 |
9.34 |
0.00 |
0.00 |
14.08 |
6.40 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
1.04 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
1124 |
1124 |
308 |
308 |
1432 |
1432 |
51.27 |
50.60 |
51.05 |
51.27 |
51.27 |
50.60 |
52.59 |
30 |
ONR-OD-8200-yolox-nano-lite-mmdet-coco-416x416 |
1.71 |
6.00 |
0.00 |
1.00 |
1.00 |
1.00 |
1.00 |
12.00 |
0.00 |
0.00 |
0.00 |
9.33 |
0.00 |
0.00 |
14.08 |
6.39 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
1.76 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
1094 |
1094 |
337 |
337 |
1431 |
1431 |
51.05 |
51.49 |
50.16 |
50.60 |
51.49 |
50.16 |
53.03 |
30 |
TFL-CL-0000-mobileNetV1-mlperf |
3.00 |
6.00 |
1.00 |
1.00 |
1.00 |
1.00 |
0.00 |
5.00 |
0.00 |
0.00 |
0.00 |
9.32 |
0.00 |
0.00 |
14.08 |
6.39 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
1.03 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
1088 |
1088 |
317 |
317 |
1405 |
1405 |
51.49 |
51.93 |
50.38 |
50.82 |
51.05 |
50.60 |
52.81 |
30 |
TFL-OD-2020-ssdLite-mobDet-DSP-coco-320x320 |
3.11 |
6.00 |
1.00 |
1.00 |
1.00 |
2.00 |
1.00 |
16.00 |
0.00 |
0.00 |
0.00 |
9.34 |
0.00 |
0.00 |
14.09 |
6.40 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
1.42 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
1214 |
1214 |
318 |
318 |
1532 |
1532 |
50.82 |
51.27 |
50.16 |
51.71 |
51.49 |
50.82 |
52.15 |
30 |