11. Datasheet (Optiflow)

The performance measurements includes the following,

  1. FPS : Effective framerate at which the application runs

  2. Total time : Average time taken to process each frame, which includes pre-processing, inference and post-processing time

  3. Inference time : Average time taken to infer each frame

  4. CPU loading : Loading on different CPU cores present

  5. DDR BW : DDR read and write BW used

  6. HWA Loading : Loading on different Hardware accelerators present

Following are the latest performance numbers of the OpTIFlow demos:

11.1. Source : Video

Resolution : 1280x768
Encoding : H264

../../../_images/datasheet_optiflow_pipeline1.png

Fig. 11.1 GStreamer based data-flow pipeline with video file input source and display output

Model

FPS

Inference time (ms)

A72 Load (%)

DDR Read BW (MB/s)

DDR Write BW (MB/s)

DDR Total BW (MB/s)

C7x Load (%)

MSC_0 (%)

MSC_1 (%)

VISS (%)

ONR-CL-6360-regNetx-200mf

30

3.52

38.07

1332

497

1829

16.0

14.19

15.34

0

ONR-OD-8200-yolox-nano-lite-mmdet-coco-416x416

30

5.55

16.32

1250

253

1503

13.0

7.24

6.80

0

TFL-CL-0000-mobileNetV1-mlperf

30

2.58

40.0

1186

481

1667

10.0

14.20

15.37

0

TFL-OD-2020-ssdLite-mobDet-DSP-coco-320x320

30

6.82

19.90

1260

233

1493

17.0

7.24

6.78

0

11.2. Source : CSI Camera with VISS (imx219)

Capture Framerate : 30 fps
Resolution : 1920x1080
format : SRGGB8

../../../_images/datasheet_optiflow_pipeline2.png

Fig. 11.2 GStreamer based data-flow pipeline with IMX219 sensor, ISP and display

Model

FPS

Inference time (ms)

A72 Load (%)

DDR Read BW (MB/s)

DDR Write BW (MB/s)

DDR Total BW (MB/s)

C7x Load (%)

MSC_0 (%)

MSC_1 (%)

VISS (%)

ONR-CL-6360-regNetx-200mf

30

3.77

14.81

1257

331

1588

8.00

14.20

7.87

9.49

ONR-OD-8200-yolox-nano-lite-mmdet-coco-416x416

30

5.56

17.58

1262

347

1609

13.0

14.29

8.90

9.56

TFL-CL-0000-mobileNetV1-mlperf

30

2.60

16.23

1185

323

1508

5.0

14.11

7.83

9.42

TFL-OD-2020-ssdLite-mobDet-DSP-coco-320x320

30

7.12

17.91

1272

326

1598

17.0

14.28

8.81

9.51