12. Datasheet (TIOVX Apps)

The performance measurements includes the following,

  1. FPS : Effective framerate at which the application runs

  2. Total time : Average time taken to process each frame, which includes pre-processing, inference and post-processing time

  3. Inference time : Average time taken to infer each frame

  4. CPU loading : Loading on different CPU cores present

  5. DDR BW : DDR read and write BW used

  6. HWA Loading : Loading on different Hardware accelerators present

Following are the latest performance numbers of the edgeai-tiovx-apps:

12.1. Source : Video

Resolution : 1280x768
Encoding : h264

Model

FPS

Total time (ms)

Inference time (ms)

A53 Load (%)

DDR Read BW (MB/s)

DDR Write BW (MB/s)

DDR Total BW (MB/s)

C7x Load (%)

MSC_0 (%)

MSC_1 (%)

VISS (%)

ONR-CL-6360-regNetx-200mf

40

23.73

4.64

35.94

1275

758

2033

28.45

55.98

26.19

0

ONR-OD-8200-yolox-nano-lite-mmdet-coco-416x416

30

32.25

9.03

30.02

1236

582

1818

43.53

41.71

18.55

0

TFL-CL-0000-mobileNetV1-mlperf

40

29.50

4.36

29.95

880

403

1283

17.53

33.11

17.53

0

TFL-OD-2020-ssdLite-mobDet-DSP-coco-320x320

30

40.06

16.96

21.30

2227

431

2658

51.96

27.66

12.26

0

12.2. Source : CSI Camera with VISS (imx219)

Capture Framerate : 30 fps
Resolution : 1920x1080
format : SRGGB8

Model

FPS

Total time (ms)

Inference time (ms)

A53 Load (%)

DDR Read BW (MB/s)

DDR Write BW (MB/s)

DDR Total BW (MB/s)

C7x Load (%)

MSC_0 (%)

MSC_1 (%)

VISS (%)

ONR-CL-6360-regNetx-200mf

20

37.43

4.57

14.64

535

233

768

9.18

24.70

8.75

11.81

ONR-OD-8200-yolox-nano-lite-mmdet-coco-416x416

20

38.38

8.89

11.32

568

231

799

9.7

20.25

7.87

11.70

TFL-CL-0000-mobileNetV1-mlperf

20

38.3

4.33

13.96

570

235

805

8.71

24.64

8.72

11.81

TFL-OD-2020-ssdLite-mobDet-DSP-coco-320x320

20

39.78

16.51

10.09

1220

243

1463

24.97

18.95

7.06

11.13