11. Datasheet¶
The performance measurements includes the following,
FPS : Effective framerate at which the application runs
Total time : Average time taken to process each frame, which includes pre-processing, inference and post-processing time
Inference time : Average time taken to infer each frame
CPU loading : Loading on different CPU cores present
DDR BW : DDR read and write BW used
HWA Loading : Loading on different Hardware accelerators present
Following are the latest performance numbers of the OpTIFlow demos:
11.1. Source : Video¶
Fig. 11.1 GStreamer based data-flow pipeline with video file input source and display output¶
Model |
FPS |
Total time (ms) |
Inference time (ms) |
A53 Load (%) |
DDR Read BW (MB/s) |
DDR Write BW (MB/s) |
DDR Total BW (MB/s) |
C7x Load (%) |
MSC_0 (%) |
MSC_1 (%) |
VISS (%) |
|---|---|---|---|---|---|---|---|---|---|---|---|
ONR-CL-6360-regNetx-200mf |
30 |
33 |
11.88 |
29.92 |
1184 |
233 |
1417 |
14.30 |
12.58 |
12.84 |
0 |
ONR-OD-8200-yolox-nano-lite-mmdet-coco-416x416 |
30 |
33 |
12.17 |
26.88 |
1342 |
294 |
1636 |
26.67 |
11.93 |
11.24 |
0 |
TFL-CL-0000-mobileNetV1-mlperf |
30 |
33 |
10.67 |
27.87 |
1246 |
232 |
1478 |
11.64 |
12.78 |
13.04 |
0 |
TFL-OD-2020-ssdLite-mobDet-DSP-coco-320x320 |
30 |
33 |
17.70 |
24.18 |
2494 |
304 |
2798 |
40.30 |
11.52 |
10.87 |
0 |
11.2. Source : USB Camera¶
Fig. 11.2 GStreamer based data-flow pipeline with USB camera input and display output¶
Model |
FPS |
Total time (ms) |
Inference time (ms) |
A53 Load (%) |
DDR Read BW (MB/s) |
DDR Write BW (MB/s) |
DDR Total BW (MB/s) |
C7x Load (%) |
MSC_0 (%) |
MSC_1 (%) |
VISS (%) |
|---|---|---|---|---|---|---|---|---|---|---|---|
ONR-CL-6360-regNetx-200mf |
30 |
33 |
11.88 |
34.39 |
1254 |
257 |
1511 |
14.50 |
12.05 |
13.07 |
0 |
ONR-OD-8200-yolox-nano-lite-mmdet-coco-416x416 |
30 |
33 |
12.17 |
34.90 |
1409 |
312 |
1721 |
27.33 |
11.52 |
11.94 |
0 |
TFL-CL-0000-mobileNetV1-mlperf |
30 |
33 |
10.67 |
33.83 |
1302 |
253 |
1555 |
11.47 |
11.84 |
12.87 |
0 |
TFL-OD-2020-ssdLite-mobDet-DSP-coco-320x320 |
30 |
33 |
17.70 |
30.37 |
2782 |
369 |
3151 |
48.86 |
12.03 |
12.05 |
0 |
11.3. Source : CSI Camera with VISS (imx219)¶
Fig. 11.3 GStreamer based data-flow pipeline with IMX219 sensor, ISP and display¶
Model |
FPS |
Total time (ms) |
Inference time (ms) |
A53 Load (%) |
DDR Read BW (MB/s) |
DDR Write BW (MB/s) |
DDR Total BW (MB/s) |
C7x Load (%) |
MSC_0 (%) |
MSC_1 (%) |
VISS (%) |
|---|---|---|---|---|---|---|---|---|---|---|---|
ONR-CL-6360-regNetx-200mf |
30 |
33 |
11.88 |
27.31 |
1243 |
316 |
1559 |
14.67 |
26.04 |
13.58 |
17.51 |
ONR-OD-8200-yolox-nano-lite-mmdet-coco-416x416 |
30 |
33 |
12.17 |
25.56 |
1277 |
310 |
1587 |
22.31 |
20.69 |
11.33 |
13.89 |
TFL-CL-0000-mobileNetV1-mlperf |
30 |
33 |
10.67 |
28.96 |
1284 |
310 |
1594 |
11.45 |
25.32 |
13.13 |
17.05 |
TFL-OD-2020-ssdLite-mobDet-DSP-coco-320x320 |
30 |
33 |
17.70 |
25.86 |
2321 |
340 |
2661 |
37.06 |
20.68 |
10.85 |
13.88 |