12. Datasheet (TIOVX Apps)

The performance measurements includes the following,

  1. FPS : Effective framerate at which the application runs

  2. Total time : Average time taken to process each frame, which includes pre-processing, inference and post-processing time

  3. Inference time : Average time taken to infer each frame

  4. CPU loading : Loading on different CPU cores present

  5. DDR BW : DDR read and write BW used

  6. HWA Loading : Loading on different Hardware accelerators present

Following are the latest performance numbers of the edgeai-tiovx-apps:

12.1. Source : Video

Resolution : 1280x768
Encoding : h264

Model

FPS

Inference time (ms)

A53 Load (%)

DDR Read BW (MB/s)

DDR Write BW (MB/s)

DDR Total BW (MB/s)

C7x Load (%)

MSC_0 (%)

MSC_1 (%)

VISS (%)

ONR-CL-6360-regNetx-200mf

30

4.78

32.51

1128

596

1724

29.21

65.37

26.18

0

ONR-OD-8200-yolox-nano-lite-mmdet-coco-416x416

30

9.11

33.08

1587

747

2334

55.24

50.56

23.67

0

TFL-CL-0000-mobileNetV1-mlperf

30

4.49

33.57

1251

607

1858

27.06

65.41

26.18

0

TFL-OD-2020-ssdLite-mobDet-DSP-coco-320x320

30

16.99

22.33

2796

509

3305

68.03

38.26

16.06

0

12.2. Source : CSI Camera with VISS (imx219)

Capture Framerate : 30 fps
Resolution : 1920x1080
format : SRGGB8

Model

FPS

Inference time (ms)

A53 Load (%)

DDR Read BW (MB/s)

DDR Write BW (MB/s)

DDR Total BW (MB/s)

C7x Load (%)

MSC_0 (%)

MSC_1 (%)

VISS (%)

ONR-CL-6360-regNetx-200mf

30

4.73

5.02

710

355

1065

14.46

38.83

13.62

17.41

ONR-OD-8200-yolox-nano-lite-mmdet-coco-416x416

30

9.04

4.86

958

438

1396

27.45

37.85

14.73

17.64

TFL-CL-0000-mobileNetV1-mlperf

30

4.50

5.06

774

359

1133

13.78

37.59

13.33

17.53

TFL-OD-2020-ssdLite-mobDet-DSP-coco-320x320

30

16.849

5.04

2227

443

2670

50.81

37.51

14.03

17.46