12. Datasheet (TIOVX Apps)

  1. FPS : Effective framerate at which the application runs

  2. Total time : Average time taken to process each frame, which includes pre-processing, inference and post-processing time

  3. Inference time : Average time taken to infer each frame

  4. CPU loading : Loading on different CPU cores present

  5. DDR BW : DDR read and write BW used

  6. HWA Loading : Loading on different Hardware accelerators present

Following are the latest performance numbers of the edgeai-tiovx-apps:

12.1. Source : Video

Resolution : 1280x768
Encoding : h264

Model

FPS

Total time (ms)

Inference time (ms)

A72 Load (%)

DDR Read BW (MB/s)

DDR Write BW (MB/s)

DDR Total BW (MB/s)

C7x Load (%)

MSC_0 (%)

MSC_1 (%)

VISS (%)

ONR-CL-6360-regNetx-200mf

60

18.74

4.27

10.69

1027

596

1623

26.45

38.36

17.20

0

ONR-OD-8200-yolox-nano-lite-mmdet-coco-416x416

60

19.60

7.75

11.69

1084

619

1703

47.71

41.30

16.31

0

TFL-CL-0000-mobileNetV1-mlperf

60

18.99

3.65

12.56

1000

603

1603

22.69

38.43

17.20

0

TFL-OD-2020-ssdLite-mobDet-DSP-coco-320x320

60

22.86

11.89

10.69

1402

605

2007

72.77

32.41

15.16

0

12.2. Source : CSI Camera with VISS (imx219)

Capture Framerate : 30 fps
Resolution : 1920x1080
format : SRGGB8

Model

FPS

Total time (ms)

Inference time (ms)

A72 Load (%)

DDR Read BW (MB/s)

DDR Write BW (MB/s)

DDR Total BW (MB/s)

C7x Load (%)

MSC_0 (%)

MSC_1 (%)

VISS (%)

ONR-CL-6360-regNetx-200mf

30

20.96

4.22

7.09

675

357

1032

13.06

24.12

8.68

11.27

ONR-OD-8200-yolox-nano-lite-mmdet-coco-416x416

30

24.53

7.58

6.74

700

347

1074

23.31

24.05

9.47

11.27

TFL-CL-0000-mobileNetV1-mlperf

30

20.40

3.64

3.23

650

353

1003

11.28

24.14

8.68

11.27

TFL-OD-2020-ssdLite-mobDet-DSP-coco-320x320

30

27.88

11.71

4.64

859

363

1222

35.80

23.97

9.06

11.27