11. Datasheet (Optiflow)

The performance measurements includes the following,

  1. FPS : Effective framerate at which the application runs

  2. Total time : Average time taken to process each frame, which includes pre-processing, inference and post-processing time

  3. Inference time : Average time taken to infer each frame

  4. CPU loading : Loading on different CPU cores present

  5. DDR BW : DDR read and write BW used

  6. HWA Loading : Loading on different Hardware accelerators present

Following are the latest performance numbers of the OpTIFlow demos:

11.1. Source : Video

Resolution : 1280x768
Encoding : h264

../../../_images/datasheet_optiflow_pipeline1.png

Fig. 11.1 GStreamer based data-flow pipeline with video file input source and display output

Model

FPS

Total time (ms)

Inference time (ms)

A53 Load (%)

DDR Read BW (MB/s)

DDR Write BW (MB/s)

DDR Total BW (MB/s)

C7x Load (%)

MSC_0 (%)

MSC_1 (%)

VISS (%)

ONR-CL-6360-regNetx-200mf

30

33

7.32

25.24

1198

243

1441

14.41

12.79

13.03

0

ONR-OD-8200-yolox-nano-lite-mmdet-coco-416x416

30

33

11.49

25.67

1159

208

1367

19.41

8.82

7.09

0

TFL-CL-0000-mobileNetV1-mlperf

30

33

5.97

25.31

1258

244

1502

13.51

12.80

13.05

0

TFL-OD-2020-ssdLite-mobDet-DSP-coco-320x320

30

33

17.70

24.51

2027

235

2262

34.97

8.67

7.77

0

11.2. Source : CSI Camera with VISS (imx219)

Capture Framerate : 30 fps
Resolution : 1920x1080
format : SRGGB8

../../../_images/datasheet_optiflow_pipeline2.png

Fig. 11.2 GStreamer based data-flow pipeline with IMX219 sensor, ISP and display

Model

FPS

Total time (ms)

Inference time (ms)

A53 Load (%)

DDR Read BW (MB/s)

DDR Write BW (MB/s)

DDR Total BW (MB/s)

C7x Load (%)

MSC_0 (%)

MSC_1 (%)

VISS (%)

ONR-CL-6360-regNetx-200mf

30

33

7.32

26.81

1258

329

1587

14.47

26.23

13.62

17.34

ONR-OD-8200-yolox-nano-lite-mmdet-coco-416x416

30

33

11.49

33.99

1594

548

2142

28.78

26.20

14.80

17.33

TFL-CL-0000-mobileNetV1-mlperf

30

33

5.97

28.88

1316

330

1646

13.73

26.21

13.74

17.34

TFL-OD-2020-ssdLite-mobDet-DSP-coco-320x320

30

33

17.70

25.60

2092

302

2394

35.01

18.11

9.43

15.96