11. Datasheet (Optiflow)¶
The performance measurements includes the following,
FPS : Effective framerate at which the application runs
Total time : Average time taken to process each frame, which includes pre-processing, inference and post-processing time
Inference time : Average time taken to infer each frame
CPU loading : Loading on different CPU cores present
DDR BW : DDR read and write BW used
HWA Loading : Loading on different Hardware accelerators present
Following are the latest performance numbers of the OpTIFlow demos:
11.1. Source : Video¶
Fig. 11.1 GStreamer based data-flow pipeline with video file input source and display output¶
Model Name |
MPU Load (%) |
MCU_2_0 Load (%) |
MCU_2_1 Load (%) |
C7x_1 Load (%) |
VISS (%) |
LDC |
BLNF |
MSC_0 (%) |
MSC_1 (%) |
DOF |
SDE |
GPU |
VISS (%) |
LDC |
BLNF |
MSC_0 (%) |
MSC_1 (%) |
DOF |
SDE |
GPU |
VISS (%) |
LDC |
BLNF |
MSC_0 (%) |
MSC_1 (%) |
DOF |
SDE |
GPU |
DDR Read BW (MB/s) |
DDR Read Peak BW (MB/s) |
DDR Write BW (MB/s) |
DDR Write Peak BW (MB/s) |
DDR Total BW (MB/s) |
DDR Total Peak BW (MB/s) |
temp_thermal_zone0(WKUP) |
temp_thermal_zone1(CPU) |
temp_thermal_zone2(C7x) |
temp_thermal_zone3(GPU) |
temp_thermal_zone4(R5F) |
FPS |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
ONR-CL-6360-regNetx-200mf |
15.57 |
9.00 |
1.00 |
8.00 |
0.00 |
0.00 |
0.00 |
7.53 |
8.30 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
1231 |
1231 |
246 |
246 |
1477 |
1477 |
63.69 |
64.13 |
65.68 |
66.33 |
64.13 |
30 |
ONR-OD-8200-yolox-nano-lite-mmdet-coco-416x416 |
14.00 |
7.00 |
1.00 |
13.00 |
0.00 |
0.00 |
0.00 |
7.53 |
7.05 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
1213 |
1213 |
248 |
248 |
1461 |
1461 |
59.89 |
60.79 |
62.14 |
62.36 |
61.69 |
30 |
TFL-CL-0000-mobileNetV1-mlperf |
15.92 |
9.00 |
1.00 |
6.00 |
0.00 |
0.00 |
0.00 |
7.53 |
8.31 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
1162 |
1162 |
237 |
237 |
1399 |
1399 |
63.91 |
65.02 |
66.55 |
66.33 |
64.80 |
30 |
TFL-OD-2020-ssdLite-mobDet-DSP-coco-320x320 |
11.28 |
6.00 |
1.00 |
17.00 |
0.00 |
0.00 |
0.00 |
7.52 |
7.07 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
1245 |
1245 |
233 |
233 |
1478 |
1478 |
61.91 |
62.80 |
63.69 |
64.13 |
63.03 |
30 |
11.2. Source : CSI Camera with VISS (imx219)¶
Fig. 11.2 GStreamer based data-flow pipeline with IMX219 sensor, ISP and display¶
Model Name |
MPU Load (%) |
MCU_2_0 Load (%) |
MCU_2_1 Load (%) |
C7x_1 Load (%) |
VISS (%) |
LDC |
BLNF |
MSC_0 (%) |
MSC_1 (%) |
DOF |
SDE |
GPU |
VISS (%) |
LDC |
BLNF |
MSC_0 (%) |
MSC_1 (%) |
DOF |
SDE |
GPU |
VISS (%) |
LDC |
BLNF |
MSC_0 (%) |
MSC_1 (%) |
DOF |
SDE |
GPU |
DDR Read BW (MB/s) |
DDR Read Peak BW (MB/s) |
DDR Write BW (MB/s) |
DDR Write Peak BW (MB/s) |
DDR Total BW (MB/s) |
DDR Total Peak BW (MB/s) |
temp_thermal_zone0(WKUP) |
temp_thermal_zone1(CPU) |
temp_thermal_zone2(C7x) |
temp_thermal_zone3(GPU) |
temp_thermal_zone4(R5F) |
FPS |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
ONR-CL-6360-regNetx-200mf |
16.90 |
12.00 |
1.00 |
8.00 |
9.62 |
0.00 |
0.00 |
14.58 |
8.90 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
1226 |
1226 |
329 |
329 |
1555 |
1555 |
67.64 |
69.15 |
69.58 |
70.23 |
68.29 |
30 |
ONR-OD-8200-yolox-nano-lite-mmdet-coco-416x416 |
7.93 |
12.00 |
1.00 |
13.00 |
9.61 |
0.00 |
0.00 |
14.59 |
10.11 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
1230 |
1230 |
344 |
344 |
1574 |
1574 |
65.24 |
65.68 |
67.64 |
68.29 |
66.55 |
30 |
TFL-CL-0000-mobileNetV1-mlperf |
11.50 |
11.00 |
1.00 |
6.00 |
9.59 |
0.00 |
0.00 |
14.56 |
8.66 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
1154 |
1154 |
320 |
320 |
1474 |
1474 |
68.07 |
69.37 |
70.01 |
71.30 |
69.37 |
30 |
TFL-OD-2020-ssdLite-mobDet-DSP-coco-320x320 |
9.54 |
12.00 |
1.00 |
17.00 |
9.61 |
0.00 |
0.00 |
14.57 |
9.05 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
0.00 |
1251 |
1251 |
323 |
323 |
1574 |
1574 |
66.77 |
67.42 |
68.94 |
69.37 |
68.29 |
30 |