11. Datasheet (Optiflow)¶
The performance measurements includes the following,
FPS : Effective framerate at which the application runs
Total time : Average time taken to process each frame, which includes pre-processing, inference and post-processing time
Inference time : Average time taken to infer each frame
CPU loading : Loading on different CPU cores present
DDR BW : DDR read and write BW used
HWA Loading : Loading on different Hardware accelerators present
Following are the latest performance numbers of the OpTIFlow demos:
11.1. Source : Video¶
Fig. 11.1 GStreamer based data-flow pipeline with video file input source and display output¶
Model Name |
MPU Load (%) |
MCU_2_0 Load (%) |
MCU_2_1 Load (%) |
C7x_1 Load (%) |
VISS (%) |
LDC |
BLNF |
MSC_0 (%) |
MSC_1 (%) |
DOF |
SDE |
GPU |
VISS (%) |
LDC |
BLNF |
MSC_0 (%) |
MSC_1 (%) |
DOF |
SDE |
GPU |
VISS (%) |
LDC |
BLNF |
MSC_0 (%) |
MSC_1 (%) |
DOF |
SDE |
GPU |
DDR Read BW (MB/s) |
DDR Read Peak BW (MB/s) |
DDR Write BW (MB/s) |
DDR Write Peak BW (MB/s) |
DDR Total BW (MB/s) |
DDR Total Peak BW (MB/s) |
temp_thermal_zone0(WKUP) |
temp_thermal_zone1(CPU) |
temp_thermal_zone2(C7x) |
temp_thermal_zone3(GPU) |
temp_thermal_zone4(R5F) |
FPS |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
ONR-CL-6360-regNetx-200mf |
12.50 |
7.00 |
1.00 |
8.00 |
0.00 |
0.00 |
0.00 |
7.23 |
7.79 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
1217 |
1217 |
245 |
245 |
1462 |
1462 |
48.81 |
48.34 |
49.28 |
50.46 |
48.57 |
30 |
ONR-OD-8200-yolox-nano-lite-mmdet-coco-416x416 |
12.68 |
6.00 |
1.00 |
12.00 |
0.00 |
0.00 |
0.00 |
7.24 |
6.78 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
1194 |
1194 |
247 |
247 |
1441 |
1441 |
46.91 |
47.62 |
48.10 |
49.28 |
47.62 |
30 |
TFL-CL-0000-mobileNetV1-mlperf |
11.34 |
7.00 |
1.00 |
5.00 |
0.00 |
0.00 |
0.00 |
7.24 |
7.80 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
1149 |
1149 |
236 |
236 |
1385 |
1385 |
48.57 |
48.81 |
48.81 |
49.99 |
48.57 |
30 |
TFL-OD-2020-ssdLite-mobDet-DSP-coco-320x320 |
11.61 |
5.00 |
1.00 |
17.00 |
0.00 |
0.00 |
0.00 |
7.24 |
6.78 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
1213 |
1213 |
228 |
228 |
1441 |
1441 |
47.86 |
48.57 |
48.81 |
49.52 |
48.10 |
30 |
11.2. Source : CSI Camera with VISS (imx219)¶
Fig. 11.2 GStreamer based data-flow pipeline with IMX219 sensor, ISP and display¶
Model Name |
MPU Load (%) |
MCU_2_0 Load (%) |
MCU_2_1 Load (%) |
C7x_1 Load (%) |
VISS (%) |
LDC |
BLNF |
MSC_0 (%) |
MSC_1 (%) |
DOF |
SDE |
GPU |
VISS (%) |
LDC |
BLNF |
MSC_0 (%) |
MSC_1 (%) |
DOF |
SDE |
GPU |
VISS (%) |
LDC |
BLNF |
MSC_0 (%) |
MSC_1 (%) |
DOF |
SDE |
GPU |
DDR Read BW (MB/s) |
DDR Read Peak BW (MB/s) |
DDR Write BW (MB/s) |
DDR Write Peak BW (MB/s) |
DDR Total BW (MB/s) |
DDR Total Peak BW (MB/s) |
temp_thermal_zone0(WKUP) |
temp_thermal_zone1(CPU) |
temp_thermal_zone2(C7x) |
temp_thermal_zone3(GPU) |
temp_thermal_zone4(R5F) |
FPS |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
ONR-CL-6360-regNetx-200mf |
9.13 |
9.00 |
1.00 |
8.00 |
9.48 |
0.00 |
0.00 |
14.26 |
8.21 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
1209 |
1209 |
327 |
327 |
1536 |
1536 |
47.86 |
48.10 |
49.05 |
49.75 |
48.34 |
30 |
ONR-OD-8200-yolox-nano-lite-mmdet-coco-416x416 |
9.54 |
10.00 |
1.00 |
12.00 |
9.48 |
0.00 |
0.00 |
14.28 |
8.98 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
1213 |
1213 |
344 |
344 |
1557 |
1557 |
47.86 |
48.57 |
49.28 |
49.75 |
48.57 |
30 |
TFL-CL-0000-mobileNetV1-mlperf |
8.67 |
9.00 |
1.00 |
6.00 |
9.48 |
0.00 |
0.00 |
14.27 |
8.20 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
1141 |
1141 |
320 |
320 |
1461 |
1461 |
48.10 |
48.57 |
48.57 |
49.99 |
47.86 |
30 |
TFL-OD-2020-ssdLite-mobDet-DSP-coco-320x320 |
12.01 |
10.00 |
1.00 |
17.00 |
9.47 |
0.00 |
0.00 |
14.28 |
8.59 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
1230 |
1230 |
322 |
322 |
1552 |
1552 |
48.34 |
48.81 |
49.05 |
49.75 |
48.10 |
30 |