10. Datasheet¶
The performance measurements includes the following,
FPS : Effective framerate at which the application runs
Total time : Average time taken to process each frame, which includes pre-processing, inference and post-processing time
Inference time : Average time taken to infer each frame
CPU loading : Loading on different CPU cores present
DDR BW : DDR read and write BW used
HWA Loading : Loading on different Hardware accelerators present
Following are the latest performance numbers of the OpTIFlow demos:
10.1. Source : Video¶
Fig. 10.1 GStreamer based data-flow pipeline with video file input source and display output¶
Model |
FPS |
Total time (ms) |
Inference time (ms) |
A53 Load (%) |
DDR Read BW (MB/s) |
DDR Write BW (MB/s) |
DDR Total BW (MB/s) |
C7x Load (%) |
MSC_0 (%) |
MSC_1 (%) |
VISS (%) |
|---|---|---|---|---|---|---|---|---|---|---|---|
ONR-CL-6360-regNetx-200mf |
30 |
33 |
11.54 |
33.75 |
1213 |
236 |
1449 |
14.53 |
12.85 |
12.76 |
0 |
ONR-OD-8200-yolox-nano-lite-mmdet-coco-416x416 |
30 |
33 |
15.72 |
36.40 |
1394 |
311 |
1705 |
28.74 |
12.83 |
11.68 |
0 |
TFL-CL-0000-mobileNetV1-mlperf |
30 |
33 |
13.47 |
35.55 |
1150 |
237 |
1387 |
12.56 |
12.85 |
12.77 |
0 |
TFL-OD-2020-ssdLite-mobDet-DSP-coco-320x320 |
30 |
33 |
15.19 |
33.33 |
1442 |
345 |
1787 |
40.90 |
12.81 |
11.67 |
0 |
10.2. Source : USB Camera¶
Fig. 10.2 GStreamer based data-flow pipeline with USB camera input and display output¶
Model |
FPS |
Total time (ms) |
Inference time (ms) |
A53 Load (%) |
DDR Read BW (MB/s) |
DDR Write BW (MB/s) |
DDR Total BW (MB/s) |
C7x Load (%) |
MSC_0 (%) |
MSC_1 (%) |
VISS (%) |
|---|---|---|---|---|---|---|---|---|---|---|---|
ONR-CL-6360-regNetx-200mf |
30 |
33 |
11.54 |
34.30 |
1252 |
247 |
1499 |
14.53 |
11.82 |
12.60 |
0 |
ONR-OD-8200-yolox-nano-lite-mmdet-coco-416x416 |
30 |
33 |
15.72 |
31.67 |
1445 |
332 |
1777 |
28.74 |
11.92 |
11.62 |
0 |
TFL-CL-0000-mobileNetV1-mlperf |
30 |
33 |
13.47 |
31.23 |
1190 |
249 |
1439 |
12.56 |
11.90 |
12.72 |
0 |
TFL-OD-2020-ssdLite-mobDet-DSP-coco-320x320 |
30 |
33 |
15.19 |
30.19 |
1485 |
366 |
1851 |
40.90 |
11.90 |
11.59 |
0 |
10.3. Source : CSI Camera with VISS (imx219)¶
Fig. 10.3 GStreamer based data-flow pipeline with IMX219 sensor, ISP and display¶
Model |
FPS |
Total time (ms) |
Inference time (ms) |
A53 Load (%) |
DDR Read BW (MB/s) |
DDR Write BW (MB/s) |
DDR Total BW (MB/s) |
C7x Load (%) |
MSC_0 (%) |
MSC_1 (%) |
VISS (%) |
|---|---|---|---|---|---|---|---|---|---|---|---|
ONR-CL-6360-regNetx-200mf |
30 |
33 |
11.54 |
32.48 |
1249 |
316 |
1565 |
14.53 |
26.34 |
13.34 |
17.70 |
ONR-OD-8200-yolox-nano-lite-mmdet-coco-416x416 |
30 |
33 |
15.72 |
31.09 |
1462 |
406 |
1868 |
28.74 |
26.37 |
14.63 |
17.70 |
TFL-CL-0000-mobileNetV1-mlperf |
30 |
33 |
13.47 |
32.25 |
1192 |
316 |
1508 |
12.56 |
26.28 |
13.41 |
17.68 |
TFL-OD-2020-ssdLite-mobDet-DSP-coco-320x320 |
30 |
33 |
15.19 |
32.83 |
1509 |
440 |
1949 |
40.90 |
26.34 |
13.99 |
17.68 |