12. Datasheet (TIOVX Apps)

  1. FPS : Effective framerate at which the application runs

  2. Total time : Average time taken to process each frame, which includes pre-processing, inference and post-processing time

  3. Inference time : Average time taken to infer each frame

  4. CPU loading : Loading on different CPU cores present

  5. DDR BW : DDR read and write BW used

  6. HWA Loading : Loading on different Hardware accelerators present

Following are the latest performance numbers of the edgeai-tiovx-apps:

12.1. Source : Video

Resolution : 1280x768
Encoding : h264

Model

FPS

Total time (ms)

Inference time (ms)

A72 Load (%)

DDR Read BW (MB/s)

DDR Write BW (MB/s)

DDR Total BW (MB/s)

C7x Load (%)

MSC_0 (%)

MSC_1 (%)

VISS (%)

ONR-CL-6360-regNetx-200mf

60

19.66

2.54

6.63

1079

611

1690

16.0

37.71

14.97

0

ONR-OD-8200-yolox-nano-lite-mmdet-coco-416x416

60

20.17

3.67

8.08

975

625

1600

23.0

37.69

13.32

0

TFL-CL-0000-mobileNetV1-mlperf

60

19.68

1.53

9.53

945

615

1560

10.00

37.84

15.00

0

TFL-OD-2020-ssdLite-mobDet-DSP-coco-320x320

60

20.27

5.06

7.61

1266

604

1870

31.0

37.91

13.30

0

12.2. Source : CSI Camera with VISS (imx219)

Capture Framerate : 30 fps
Resolution : 1920x1080
format : SRGGB8

Model

FPS

Total time (ms)

Inference time (ms)

A72 Load (%)

DDR Read BW (MB/s)

DDR Write BW (MB/s)

DDR Total BW (MB/s)

C7x Load (%)

MSC_0 (%)

MSC_1 (%)

VISS (%)

ONR-CL-6360-regNetx-200mf

30

15.37

2.53

8.67

700

362

1062

8.0

20.30

7.51

9.46

ONR-OD-8200-yolox-nano-lite-mmdet-coco-416x416

30

16.87

3.62

6.82

659

376

1035

12.0

20.38

8.22

9.50

TFL-CL-0000-mobileNetV1-mlperf

30

14.126

1.52

22.11

631

357

988

5.00

20.17

7.45

9.38

TFL-OD-2020-ssdLite-mobDet-DSP-coco-320x320

30

17.85

5.01

6.34

796

372

1168

16.0

20.36

7.89

9.50