12. Datasheet (TIOVX Apps)

  1. FPS : Effective framerate at which the application runs

  2. Total time : Average time taken to process each frame, which includes pre-processing, inference and post-processing time

  3. Inference time : Average time taken to infer each frame

  4. CPU loading : Loading on different CPU cores present

  5. DDR BW : DDR read and write BW used

  6. HWA Loading : Loading on different Hardware accelerators present

Following are the latest performance numbers of the edgeai-tiovx-apps:

12.1. Source : Video

Resolution : 1280x768
Encoding : h264

Model

FPS

Inference time (ms)

A72 Load (%)

DDR Read BW (MB/s)

DDR Write BW (MB/s)

DDR Total BW (MB/s)

C7x Load (%)

MSC_0 (%)

MSC_1 (%)

VISS (%)

ONR-CL-6360-regNetx-200mf

60

3.078

10.98

1083

720

1803

24.0

47.05

16.83

0

ONR-OD-8200-yolox-nano-lite-mmdet-coco-416x416

60

4.012

12.0

916

740

1656

31.0

47.41

16.91

0

TFL-CL-0000-mobileNetV1-mlperf

60

1.632

12.89

925

740

1665

13.00

47.09

16.83

0

TFL-OD-2020-ssdLite-mobDet-DSP-coco-320x320

60

5.47

11.97

1264

705

1969

42.0

47.43

16.91

0

12.2. Source : CSI Camera with VISS (imx219)

Capture Framerate : 30 fps
Resolution : 1920x1080
format : SRGGB8

Model

FPS

Inference time (ms)

A72 Load (%)

DDR Read BW (MB/s)

DDR Write BW (MB/s)

DDR Total BW (MB/s)

C7x Load (%)

MSC_0 (%)

MSC_1 (%)

VISS (%)

ONR-CL-6360-regNetx-200mf

30

3.098

1.08

549

341

890

10.0

20.23

6.63

9.32

ONR-OD-8200-yolox-nano-lite-mmdet-coco-416x416

30

3.974

1.21

489

362

851

12.0

20.64

6.61

9.36

TFL-CL-0000-mobileNetV1-mlperf

30

1.634

0.97

473

343

816

5.00

20.67

6.60

9.34

TFL-OD-2020-ssdLite-mobDet-DSP-coco-320x320

30

5.431

0.36

625

354

979

17.0

20.68

6.61

9.35