11. Datasheet

Performance data of the demos can be auto generated by running following command on target:

/opt/edgeai-gst-apps/tests# ./gen_data_sheet.sh

The performance measurements includes the following,

  1. FPS : Effective framerate at which the application runs

  2. Total time : Average time taken to process each frame, which includes pre-processing, inference and post-processing time

  3. Inference time : Average time taken to infer each frame

  4. CPU loading : Loading on different CPU cores present

  5. DDR BW : DDR read and write BW used

  6. HWA Loading : Loading on different Hardware accelerators present

Following are the latest performance numbers of the C++ demos:

11.1. Source : Video

Video Framerate : 30 fps Resolution : 720p Encoding : h264

../../../_images/edgeai_video_source_optiflow1.jpg

Fig. 11.1 GStreamer based data-flow pipeline with video file input source and display output

Model

FPS

Total time (ms)

Inference time (ms)

A72 Load (%)

DDR Read BW (MB/s)

DDR Write BW (MB/s)

DDR Total BW (MB/s)

C71 Load (%)

C66_1 Load (%)

C66_2 Load (%)

MCU2_0 Load (%)

MCU2_1 Load (%)

MSC_0 (%)

MSC_1 (%)

VISS (%)

NF (%)

LDC (%)

SDE (%)

DOF (%)

ONR-CL-6360-regNetx-200mf

30.50

33.09

2.14

42.2

1704

636

2340

8.0

22.0

9.0

4.0

1.0

6.75

6.75

0

0

0

0

0

ONR-OD-8220-yolox-s-lite-mmdet-coco-640x640

30.36

33.19

11.36

40.67

2033

790

2823

32.0

76.0

9.0

4.0

1.0

6.75

6.76

0

0

0

0

0

TFL-CL-0000-mobileNetV1-mlperf

30.54

33.12

1.67

40.0

1675

636

2311

7.0

22.0

9.0

4.0

1.0

6.85

6.70

0

0

0

0

0

TFL-OD-2020-ssdLite-mobDet-DSP-coco-320x320

30.38

33.22

5.05

35.83

1725

615

2340

16.0

29.0

9.0

4.0

1.0

6.78

6.66

0

0

0

0

0

11.2. Source : USB Camera

Capture Framerate : 30 fps Resolution : 720p format : JPEG

../../../_images/edgeai_object_detection_optiflow.jpg

Fig. 11.2 GStreamer based data-flow pipeline with USB camera input and display output

Model

FPS

Total time (ms)

Inference time (ms)

A72 Load (%)

DDR Read BW (MB/s)

DDR Write BW (MB/s)

DDR Total BW (MB/s)

C71 Load (%)

C66_1 Load (%)

C66_2 Load (%)

MCU2_0 Load (%)

MCU2_1 Load (%)

MSC_0 (%)

MSC_1 (%)

VISS (%)

NF (%)

LDC (%)

SDE (%)

DOF (%)

ONR-CL-6360-regNetx-200mf

30.83

33.31

2.02

22.68

1470

534

2004

6.0

21.0

9.0

4.0

1.0

6.67

6.70

0

0

0

0

0

ONR-OD-8220-yolox-s-lite-mmdet-coco-640x640

30.83

33.26

11.50

24.18

1796

689

2485

33.0

76.0

9.0

4.0

1.0

7.19

6.79

0

0

0

0

0

TFL-CL-0000-mobileNetV1-mlperf

30.84

33.24

1.04

36.20

1426

529

1955

5.0

22.0

9.0

4.0

1.0

6.78

6.73

0

0

0

0

0

TFL-OD-2020-ssdLite-mobDet-DSP-coco-320x320

30.68

33.25

5.01

24.32

1510

523

2033

15.0

29.0

9.0

4.0

1.0

7.18

6.82

0

0

0

0

0

11.3. Source : CSI Camera with VISS (imx219)

Capture Framerate : 30 fps Resolution : 1080p format : SRGGB8

../../../_images/edgeai_rpi_camera_source_optiflow.jpg

Fig. 11.3 GStreamer based data-flow pipeline with IMX219 sensor, ISP and display

Model

FPS

Total time (ms)

Inference time (ms)

A72 Load (%)

DDR Read BW (MB/s)

DDR Write BW (MB/s)

DDR Total BW (MB/s)

C71 Load (%)

C66_1 Load (%)

C66_2 Load (%)

MCU2_0 Load (%)

MCU2_1 Load (%)

MSC_0 (%)

MSC_1 (%)

VISS (%)

NF (%)

LDC (%)

SDE (%)

DOF (%)

ONR-CL-6360-regNetx-200mf

30.89

33.07

2.00

15.63

1504

604

2108

6.0

17.0

9.0

8.0

1.0

14.15

8.18

9.95

0

0

0

0

ONR-OD-8220-yolox-s-lite-mmdet-coco-640x640

30.45

33.13

11.02

14.39

1822

756

2578

32.0

72.0

9.0

8.0

1.0

14.4

7.12

9.97

0

0

0

0

TFL-CL-0000-mobileNetV1-mlperf

30.74

33.11

1.01

14.89

1464

603

2067

5.0

18.0

9.0

8.0

1.0

14.18

8.18

9.81

0

0

0

0

TFL-OD-2020-ssdLite-mobDet-DSP-coco-320x320

30.67

33.16

5.01

11.80

1553

594

2147

16.0

25.0

9.0

8.0

1.0

16.18

8.54

9.95

0

0

0

0