11. Datasheet

  1. FPS : Effective framerate at which the application runs

  2. Total time : Average time taken to process each frame, which includes pre-processing, inference and post-processing time

  3. Inference time : Average time taken to infer each frame

  4. CPU loading : Loading on different CPU cores present

  5. DDR BW : DDR read and write BW used

  6. HWA Loading : Loading on different Hardware accelerators present

Following are the latest performance numbers of the OpTIFlow demos:

11.1. Source : Video

Video Framerate : 30 fps
Resolution : 1280x768
Encoding : h264

../../../_images/datasheet_pipeline1.png

Fig. 11.1 GStreamer based data-flow pipeline with video file input source and display output

Model

FPS

Total time (ms)

Inference time (ms)

A72 Load (%)

DDR Read BW (MB/s)

DDR Write BW (MB/s)

DDR Total BW (MB/s)

C7x Load (%)

MSC_0 (%)

MSC_1 (%)

VISS (%)

ONR-CL-6360-regNetx-200mf

30

33

3.01

3.17

1074

228

1302

9.0

7.05

6.61

0

ONR-OD-8200-yolox-nano-lite-mmdet-coco-416x416

30

33

4.39

3.17

1043

242

1285

12.0

7.06

6.62

0

TFL-CL-0000-mobileNetV1-mlperf

30

33

2.4

3.27

1022

227

1249

5.0

7.05

6.61

0

TFL-OD-2020-ssdLite-mobDet-DSP-coco-320x320

30

33

5.02

3.16

1149

221

1370

16.0

7.06

6.62

0

11.2. Source : USB Camera

Capture Framerate : 30 fps
Resolution : 1280x720
format : JPEG

../../../_images/datasheet_pipeline2.png

Fig. 11.2 GStreamer based data-flow pipeline with USB camera input and display output

Model

FPS

Total time (ms)

Inference time (ms)

A72 Load (%)

DDR Read BW (MB/s)

DDR Write BW (MB/s)

DDR Total BW (MB/s)

C7x Load (%)

MSC_0 (%)

MSC_1 (%)

VISS (%)

ONR-CL-6360-regNetx-200mf

30

33

3.01

5.90

1109

248

1357

9.0

6.44

6.55

0

ONR-OD-8200-yolox-nano-lite-mmdet-coco-416x416

30

33

4.39

6.75

1056

266

1322

12.0

6.46

6.36

0

TFL-CL-0000-mobileNetV1-mlperf

30

33

2.4

6.48

1024

244

1268

5.0

6.44

6.36

0

TFL-OD-2020-ssdLite-mobDet-DSP-coco-320x320

30

33

5.02

6.00

1182

247

1429

16.0

6.56

6.46

0

11.3. Source : CSI Camera with VISS (imx219)

Capture Framerate : 30 fps
Resolution : 1920x1080
format : SRGGB8
../../../_images/datasheet_pipeline3.png

Fig. 11.3 GStreamer based data-flow pipeline with IMX219 sensor, ISP and display

Model

FPS

Total time (ms)

Inference time (ms)

A72 Load (%)

DDR Read BW (MB/s)

DDR Write BW (MB/s)

DDR Total BW (MB/s)

C7x Load (%)

MSC_0 (%)

MSC_1 (%)

VISS (%)

ONR-CL-6360-regNetx-200mf

30

33

3.01

2.81

1110

306

1416

9.0

13.92

6.41

10.20

ONR-OD-8200-yolox-nano-lite-mmdet-coco-416x416

30

33

4.39

3.04

1075

333

1408

12.0

13.82

6.56

10.13

TFL-CL-0000-mobileNetV1-mlperf

30

33

2.4

2.57

1047

304

1351

5.0

14.12

6.52

10.03

TFL-OD-2020-ssdLite-mobDet-DSP-coco-320x320

30

33

5.02

3.15

1193

313

1506

16.0

14.10

6.49

10.34