12. Datasheet (TIOVX Apps)

The performance measurements includes the following,

  1. FPS : Effective framerate at which the application runs

  2. Total time : Average time taken to process each frame, which includes pre-processing, inference and post-processing time

  3. Inference time : Average time taken to infer each frame

  4. CPU loading : Loading on different CPU cores present

  5. DDR BW : DDR read and write BW used

  6. HWA Loading : Loading on different Hardware accelerators present

Following are the latest performance numbers of the edgeai-tiovx-apps:

12.1. Source : Video

Resolution : 1280x768
Encoding : H264

Model

FPS

Total time (ms)

Inference time (ms)

A72 Load (%)

DDR Read BW (MB/s)

DDR Write BW (MB/s)

DDR Total BW (MB/s)

C7x Load (%)

MSC_0 (%)

MSC_1 (%)

VISS (%)

ONR-CL-6360-regNetx-200mf

60

19.19

2.43

12.56

1058

637

1695

15.0

37.69

16.27

0

ONR-OD-8200-yolox-nano-lite-mmdet-coco-416x416

60

19.57

3.88

9.09

1088

654

1742

24.0

37.67

14.31

0

TFL-CL-0000-mobileNetV1-mlperf

60

19.89

1.51

6.70

968

635

1603

10.0

37.67

16.30

0

TFL-OD-2020-ssdLite-mobDet-DSP-coco-320x320

60

19.89

5.27

9.00

1171

628

1799

33.00

37.68

14.12

0

12.2. Source : CSI Camera with VISS (imx219)

Capture Framerate : 30 fps
Resolution : 1920x1080
format : SRGGB8

Model

FPS

Total time (ms)

Inference time (ms)

A72 Load (%)

DDR Read BW (MB/s)

DDR Write BW (MB/s)

DDR Total BW (MB/s)

C7x Load (%)

C66_1 Load (%)

C66_2 Load (%)

MSC_0 (%)

MSC_1 (%)

VISS (%)

ONR-CL-6360-regNetx-200mf

30

16.29

2.41

10.20

633

358

991

8.00

20.71

7.96

9.57

ONR-OD-8200-yolox-nano-lite-mmdet-coco-416x416

30

17.89

3.81

5.41

649

373

1022

12.0

20.81

8.69

9.63

TFL-CL-0000-mobileNetV1-mlperf

30

15.39

1.51

29.06

581

354

935

5.0

20.51

7.89

9.47

TFL-OD-2020-ssdLite-mobDet-DSP-coco-320x320

30

19.11

5.27

3.03

695

364

1059

17.0

20.78

8.35

9.62