12. Datasheet (TIOVX Apps)

  1. FPS : Effective framerate at which the application runs

  2. Total time : Average time taken to process each frame, which includes pre-processing, inference and post-processing time

  3. Inference time : Average time taken to infer each frame

  4. CPU loading : Loading on different CPU cores present

  5. DDR BW : DDR read and write BW used

  6. HWA Loading : Loading on different Hardware accelerators present

Following are the latest performance numbers of the edgeai-tiovx-apps:

12.1. Source : Video

Resolution : 1280x768
Encoding : h264

Model Name

MPU Load (%)

C7x_0 Load (%)

C7x_1 Load (%)

MSC0 Load (%)

MSC1 Load (%)

DDR Read BW (MB/s)

DDR Write BW (MB/s)

DDR Total BW (MB/s)

FPS

Inference time (ms)

ONR-OD-8200-yolox-nano-lite-mmdet-coco-416x416

11.11

50.27

0.01

38.32

15.42

1144

679

1823

60

8.274

TFL-OD-2020-ssdLite-mobDet-DSP-coco-320x320

10.10

77.26

0.01

32.19

15.07

1414

599

2013

60

12.774

ONR-CL-6360-regNetx-200mf

8.60

28.07

0.01

38.56

17.16

1081

584

1665

60

4.585

TFL-CL-0000-mobileNetV1-mlperf

11.25

24.85

0.01

38.56

17.13

1006

591

1597

60

4.051

12.2. Source : CSI Camera with VISS (imx219)

Capture Framerate : 30 fps
Resolution : 1920x1080
format : SRGGB8

Model Name

MPU Load (%)

C7x_0 Load (%)

C7x_1 Load (%)

VISS Load (%)

MSC0 Load (%)

MSC1 Load (%)

DDR Read BW (MB/s)

DDR Write BW (MB/s)

DDR Total BW (MB/s)

FPS

Inference time (ms)

ONR-OD-8200-yolox-nano-lite-mmdet-coco-416x416

4.88

24.93

0.01

10.88

24.79

9.60

728

404

1132

30

8.201

TFL-OD-2020-ssdLite-mobDet-DSP-coco-320x320

6.44

38.35

0.01

10.90

24.80

9.21

870

363

1233

30

12.668

ONR-CL-6360-regNetx-200mf

4.85

14.16

0.01

10.88

24.79

8.78

697

350

1047

30

4.622

TFL-CL-0000-mobileNetV1-mlperf

5.31

12.50

0.01

10.88

24.78

8.77

657

351

1008

30

4.071