2.5.1. RT-linux 12.00.00 Performance Guide

2.5.1.1. Read This First

All performance numbers provided in this document are gathered using following Evaluation Modules unless otherwise specified.

Name

Description

AM64x EVM

AM64x Evaluation Module rev E1 with ARM running at 1GHz, DDR data rate 1600 MT/S

Table: Evaluation Modules

2.5.1.2. About This Manual

This document provides performance data for each of the device drivers which are part of the Processor SDK Linux package. This document should be used in conjunction with release notes and user guides provided with the Processor SDK Linux package for information on specific issues present with drivers included in a particular release.

For further information or to report any problems, contact https://e2e.ti.com/ or https://support.ti.com/


2.5.1.3. System Benchmarks

2.5.1.3.1. Stress-ng and Cyclic Test

stress-ng (next-generation) will stress test a embedded platform in various selectable ways. It was designed to exercise various physical subsystems as well as the various operating system kernel interfaces. stress-ng can also measure test throughput rates; this can be useful to observe performance changes across different operating system or types of hardware.

Cyclictest is most commonly used for benchmarking RT systems. It is one of the most frequently used tools for evaluating the relative performance of real-time systems. Some performance tests which use Cyclictest are System benchmarking, Latency debugging with tracing and -approximating application performance.

Test commands used for running stress-ng and cyclictest together

stress-ng --cpu-method=all -c 4 &
cyclictest -m -Sp80 -D6h -h400 -i200 -M -q

The following summarizes the latencies observed using the yocto based default SDK image:

Note

A known issue in this SDK release is affecting this benchmark. Using OP-TEE’s PRNG drivers rather than the hardware accelerated TRNG drivers restores the context switch latencies to the values you see here.

More information on switching to the PRNG drivers can be found in the Foundational Components section, here Building OP-TEE with Pseudo RNG drivers

Latencies

CPU 0

CPU 1

Minimum (usec)

5

5

Average (usec)

7

8

Maximum (usec)

69

77

../../../_images/rt-cpu-method-all-latency-histogram.png

2.5.1.3.2. LMBench

LMBench is a collection of microbenchmarks of which the memory bandwidth and latency related ones are typically used to estimate processor memory system performance. More information about lmbench at https://lmbench.sourceforge.net/whatis_lmbench.html and https://lmbench.sourceforge.net/man/lmbench.8.html

Latency: lat_mem_rd-stride128-szN, where N is equal to or smaller than the cache size at given level measures the cache miss penalty. N that is at least double the size of last level cache is the latency to external memory.

Bandwidth: bw_mem_bcopy-N, where N is equal to or smaller than the cache size at a given level measures the achievable memory bandwidth from software doing a memcpy() type operation. Typical use is for external memory bandwidth calculation. The bandwidth is calculated as byte read and written counts as 1 which should be roughly half of STREAM copy result.

Execute the LMBench with the following:

cd /opt/ltp
./runltp -P j721e-idk-gw -f ddt/lmbench -s LMBENCH_L_PERF_0001
Table 2.3 LMBench Benchmarks

Benchmarks

am64xx-hsevm: perf

af_unix_sock_stream_latency (microsec)

29.27 (min 24.87, max 39.15)

af_unix_socket_stream_bandwidth (mbs)

558.67 (min 544.62, max 577.21)

bw_file_rd-io-1mb (mb/s)

842.86 (min 820.61, max 860.44)

bw_file_rd-o2c-1mb (mb/s)

494.65 (min 478.77, max 505.56)

bw_mem-bcopy-16mb (mb/s)

949.99 (min 921.34, max 973.47)

bw_mem-bcopy-1mb (mb/s)

943.11 (min 906.76, max 975.93)

bw_mem-bcopy-2mb (mb/s)

933.38 (min 918.70, max 958.47)

bw_mem-bcopy-4mb (mb/s)

960.36 (min 924.21, max 978.47)

bw_mem-bcopy-8mb (mb/s)

954.73 (min 901.51, max 986.19)

bw_mem-bzero-16mb (mb/s)

2117.57 (min 2115.56, max 2118.36)

bw_mem-bzero-1mb (mb/s)

1530.94 (min 906.76, max 2120.52)

bw_mem-bzero-2mb (mb/s)

1525.61 (min 918.70, max 2118.64)

bw_mem-bzero-4mb (mb/s)

1538.69 (min 924.21, max 2117.90)

bw_mem-bzero-8mb (mb/s)

1536.19 (min 901.51, max 2118.92)

bw_mem-cp-16mb (mb/s)

561.34 (min 542.93, max 581.71)

bw_mem-cp-1mb (mb/s)

1606.01 (min 557.72, max 2718.38)

bw_mem-cp-2mb (mb/s)

1439.68 (min 534.62, max 2352.94)

bw_mem-cp-4mb (mb/s)

1383.16 (min 524.25, max 2227.17)

bw_mem-cp-8mb (mb/s)

1359.16 (min 537.42, max 2167.43)

bw_mem-fcp-16mb (mb/s)

1043.67 (min 1008.64, max 1082.84)

bw_mem-fcp-1mb (mb/s)

1605.66 (min 1081.08, max 2120.52)

bw_mem-fcp-2mb (mb/s)

1568.44 (min 966.81, max 2118.64)

bw_mem-fcp-4mb (mb/s)

1582.47 (min 951.70, max 2117.90)

bw_mem-fcp-8mb (mb/s)

1571.60 (min 959.23, max 2118.92)

bw_mem-frd-16mb (mb/s)

1311.63 (min 1279.49, max 1329.57)

bw_mem-frd-1mb (mb/s)

1200.07 (min 1081.08, max 1331.78)

bw_mem-frd-2mb (mb/s)

1168.93 (min 966.81, max 1370.33)

bw_mem-frd-4mb (mb/s)

1181.54 (min 951.70, max 1369.63)

bw_mem-frd-8mb (mb/s)

1170.23 (min 959.23, max 1367.05)

bw_mem-fwr-16mb (mb/s)

2128.04 (min 2125.96, max 2129.93)

bw_mem-fwr-1mb (mb/s)

1965.95 (min 1273.19, max 2718.38)

bw_mem-fwr-2mb (mb/s)

1819.17 (min 1265.22, max 2352.94)

bw_mem-fwr-4mb (mb/s)

1760.80 (min 1275.31, max 2227.17)

bw_mem-fwr-8mb (mb/s)

1737.99 (min 1241.85, max 2167.43)

bw_mem-rd-16mb (mb/s)

1332.85 (min 1270.14, max 1382.89)

bw_mem-rd-1mb (mb/s)

1102.66 (min 850.77, max 1419.88)

bw_mem-rd-2mb (mb/s)

1086.05 (min 821.81, max 1365.89)

bw_mem-rd-4mb (mb/s)

1104.47 (min 856.62, max 1380.74)

bw_mem-rd-8mb (mb/s)

1116.97 (min 863.84, max 1397.38)

bw_mem-rdwr-16mb (mb/s)

878.96 (min 870.37, max 884.08)

bw_mem-rdwr-1mb (mb/s)

698.17 (min 557.72, max 847.46)

bw_mem-rdwr-2mb (mb/s)

684.70 (min 534.62, max 828.16)

bw_mem-rdwr-4mb (mb/s)

697.23 (min 524.25, max 855.25)

bw_mem-rdwr-8mb (mb/s)

713.67 (min 537.42, max 878.54)

bw_mem-wr-16mb (mb/s)

898.11 (min 890.57, max 901.46)

bw_mem-wr-1mb (mb/s)

835.61 (min 768.34, max 890.31)

bw_mem-wr-2mb (mb/s)

823.57 (min 790.62, max 852.64)

bw_mem-wr-4mb (mb/s)

850.08 (min 805.07, max 878.64)

bw_mem-wr-8mb (mb/s)

875.81 (min 858.74, max 897.87)

bw_mmap_rd-mo-1mb (mb/s)

1288.67 (min 1251.79, max 1327.27)

bw_mmap_rd-o2c-1mb (mb/s)

503.15 (min 477.40, max 532.86)

bw_pipe (mb/s)

559.24 (min 519.56, max 584.19)

bw_unix (mb/s)

558.67 (min 544.62, max 577.21)

lat_connect (us)

69.65 (min 68.59, max 71.76)

lat_ctx-2-128k (us)

17.41 (min 8.52, max 35.96)

lat_ctx-2-256k (us)

59.43 (min 18.26, max 137.82)

lat_ctx-4-128k (us)

33.39 (min 10.30, max 79.35)

lat_ctx-4-256k (us)

57.09 (min 5.26, max 145.73)

lat_fs-0k (num_files)

222.33 (min 204.00, max 253.00)

lat_fs-10k (num_files)

97.33 (min 88.00, max 117.00)

lat_fs-1k (num_files)

138.83 (min 128.00, max 152.00)

lat_fs-4k (num_files)

129.17 (min 126.00, max 135.00)

lat_mem_rd-stride128-sz1000k (ns)

46.99 (min 46.70, max 48.08)

lat_mem_rd-stride128-sz125k (ns)

7.81 (min 7.80, max 7.85)

lat_mem_rd-stride128-sz250k (ns)

13.11 (min 10.29, max 17.26)

lat_mem_rd-stride128-sz31k (ns)

4.69 (min 3.06, max 5.89)

lat_mem_rd-stride128-sz50 (ns)

3.02

lat_mem_rd-stride128-sz500k (ns)

42.92 (min 42.10, max 44.04)

lat_mem_rd-stride128-sz62k (ns)

7.37 (min 7.35, max 7.39)

lat_mmap-1m (us)

61.50 (min 58.00, max 71.00)

lat_ops-double-add (ns)

4.02

lat_ops-double-div (ns)

22.13 (min 22.12, max 22.14)

lat_ops-double-mul (ns)

4.02

lat_ops-float-add (ns)

4.02

lat_ops-float-div (ns)

13.08 (min 13.06, max 13.11)

lat_ops-float-mul (ns)

4.02

lat_ops-int-add (ns)

1.01

lat_ops-int-bit (ns)

0.67

lat_ops-int-div (ns)

6.04 (min 6.03, max 6.05)

lat_ops-int-mod (ns)

6.38 (min 6.37, max 6.40)

lat_ops-int-mul (ns)

4.34 (min 4.27, max 4.38)

lat_ops-int64-add (ns)

1.01

lat_ops-int64-bit (ns)

0.67

lat_ops-int64-div (ns)

9.55

lat_ops-int64-mod (ns)

7.38 (min 7.37, max 7.38)

lat_ops-int64-mul (ns)

5.05 (min 4.98, max 5.11)

lat_pagefault (us)

1.66 (min 1.57, max 1.75)

lat_pipe (us)

21.07 (min 20.07, max 21.69)

lat_proc-exec (us)

1192.27 (min 1137.20, max 1275.60)

lat_proc-fork (us)

1074.68 (min 1031.00, max 1137.60)

lat_proc-proccall (us)

0.01

lat_select (us)

42.85 (min 42.28, max 43.92)

lat_sem (us)

2.57 (min 1.71, max 3.19)

lat_sig-catch (us)

6.09 (min 5.83, max 6.30)

lat_sig-install (us)

0.94 (min 0.87, max 1.10)

lat_sig-prot (us)

0.81 (min 0.66, max 0.94)

lat_syscall-fstat (us)

2.31 (min 2.13, max 2.49)

lat_syscall-null (us)

0.52 (min 0.44, max 0.65)

lat_syscall-open (us)

345.64 (min 311.94, max 360.53)

lat_syscall-read (us)

0.80 (min 0.69, max 0.89)

lat_syscall-stat (us)

5.88 (min 5.61, max 6.20)

lat_syscall-write (us)

0.76 (min 0.66, max 0.87)

lat_tcp (us)

0.97 (min 0.75, max 1.22)

lat_unix (us)

29.27 (min 24.87, max 39.15)

latency_for_0.50_mb_block_size (nanosec)

42.92 (min 42.10, max 44.04)

latency_for_1.00_mb_block_size (nanosec)

23.50 (min 0.00, max 48.08)

pipe_bandwidth (mbs)

559.24 (min 519.56, max 584.19)

pipe_latency (microsec)

21.07 (min 20.07, max 21.69)

procedure_call (microsec)

0.01

select_on_200_tcp_fds (microsec)

42.85 (min 42.28, max 43.92)

semaphore_latency (microsec)

2.57 (min 1.71, max 3.19)

signal_handler_latency (microsec)

0.94 (min 0.87, max 1.10)

signal_handler_overhead (microsec)

6.09 (min 5.83, max 6.30)

tcp_ip_connection_cost_to_localhost (microsec)

69.65 (min 68.59, max 71.76)

tcp_latency_using_localhost (microsec)

0.97 (min 0.75, max 1.22)

2.5.1.3.3. Dhrystone

Dhrystone is a core only benchmark that runs from warm L1 caches in all modern processors. It scales linearly with clock speed. For standard ARM cores the DMIPS/MHz score will be identical with the same compiler and flags.

Table 2.4 Dhrystone Benchmarks

Benchmarks

am64xx-hsevm: perf

cpu_clock (mhz)

1000.00

dhrystone_per_mhz (dmips/mhz)

2.76 (min 2.70, max 2.80)

dhrystone_per_second (dhrystonep)

4855981.60 (min 4761905.00, max 5000000.00)

2.5.1.3.4. Whetstone

Table 2.5 Whetstone Benchmarks

Benchmarks

am64xx-hsevm: perf

whetstone (mips)

3611.08 (min 3333.30, max 5000.00)

2.5.1.3.5. Linpack

Linpack measures peak double precision (64 bit) floating point performance in solving a dense linear system.

Table 2.6 Linpack Benchmarks

Benchmarks

am64xx-hsevm: perf

linpack (kflops)

411621.33 (min 411424.00, max 411819.00)

2.5.1.3.6. CoreMarkPro

CoreMark®-Pro is a comprehensive, advanced processor benchmark that works with and enhances the market-proven industry-standard EEMBC CoreMark® benchmark. While CoreMark stresses the CPU pipeline, CoreMark-Pro tests the entire processor, adding comprehensive support for multicore technology, a combination of integer and floating-point workloads, and data sets for utilizing larger memory subsystems.

Table 2.7 CoreMarkPro Benchmarks

Benchmarks

am64xx-hsevm: perf

cjpeg-rose7-preset (workloads/)

29.60 (min 29.41, max 29.85)

core (workloads/)

0.21

coremark-pro ()

592.17 (min 585.01, max 602.59)

linear_alg-mid-100x100-sp (workloads/)

10.41 (min 10.38, max 10.43)

loops-all-mid-10k-sp (workloads/)

0.48 (min 0.48, max 0.49)

nnet_test (workloads/)

0.76 (min 0.76, max 0.77)

parser-125k (workloads/)

5.61 (min 5.29, max 6.17)

radix2-big-64k (workloads/)

20.77 (min 20.27, max 21.14)

sha-test (workloads/)

57.80

zip-test (workloads/)

15.75 (min 15.63, max 16.13)

Table 2.8 CoreMarkProTwoCore Benchmarks

Benchmarks

am64xx-hsevm: perf

cjpeg-rose7-preset (workloads/)

58.09 (min 57.47, max 58.82)

core (workloads/)

0.43

coremark-pro ()

1037.34 (min 981.69, max 1065.66)

linear_alg-mid-100x100-sp (workloads/)

20.81 (min 20.78, max 20.83)

loops-all-mid-10k-sp (workloads/)

0.88

nnet_test (workloads/)

1.53

parser-125k (workloads/)

5.99 (min 4.91, max 6.99)

radix2-big-64k (workloads/)

32.45 (min 31.58, max 33.23)

sha-test (workloads/)

114.94

zip-test (workloads/)

26.01 (min 14.39, max 28.57)


2.5.1.3.7. Boot-time Measurement

2.5.1.3.7.1. Boot media: MMCSD

Table 2.9 Linux boot time MMCSD

Boot Configuration

am64xx-hsevm: Boot time in seconds: avg(min,max)

Linux boot time from SD with default rootfs (20 boot cycles)

28.67 (min 22.45, max 36.73)

Boot time numbers [avg, min, max] are measured from “Starting kernel” to Linux prompt across 20 boot cycles.


2.5.1.3.8. Ethernet

Ethernet performance benchmarks were measured using netperf 2.7.1 https://hewlettpackard.github.io/netperf/doc/netperf.html Test procedures were modeled after those defined in RFC-2544: https://tools.ietf.org/html/rfc2544, where the DUT is the TI device and the “tester” used was a Linux PC. To produce consistent results, it is recommended to carry out performance tests in a private network and to avoid running NFS on the same interface used in the test. In these results, CPU utilization was captured as the total percentage used across all cores on the device, while running the performance test over one external interface.

UDP Throughput (0% loss) was measured by the procedure defined in RFC-2544 section 26.1: Throughput. In this scenario, netperf options burst_size (-b) and wait_time (-w) are used to limit bandwidth during different trials of the test, with the goal of finding the highest rate at which no loss is seen. For example, to limit bandwidth to 500Mbits/sec with 1472B datagram:

burst_size = <bandwidth (bits/sec)> / 8 (bits -> bytes) / <UDP datagram size> / 100 (seconds -> 10 ms)
burst_size = 500000000 / 8 / 1472 / 100 = 425

wait_time = 10 milliseconds (minimum supported by Linux PC used for testing)

UDP Throughput (possible loss) was measured by capturing throughput and packet loss statistics when running the netperf test with no bandwidth limit (remove -b/-w options).

In order to start a netperf client on one device, the other device must have netserver running. To start netserver:

netserver [-p <port_number>] [-4 (IPv4 addressing)] [-6 (IPv6 addressing)]

Running the following shell script from the DUT will trigger netperf clients to measure bidirectional TCP performance for 60 seconds and report CPU utilization. Parameter -k is used in client commands to summarize selected statistics on their own line and -j is used to gain additional timing measurements during the test.

#!/bin/bash
for i in 1
do
   netperf -H <tester ip> -j -c -l 60 -t TCP_STREAM --
      -k DIRECTION,THROUGHPUT,MEAN_LATENCY,LOCAL_CPU_UTIL,REMOTE_CPU_UTIL,LOCAL_BYTES_SENT,REMOTE_BYTES_RECVD,LOCAL_SEND_SIZE &

   netperf -H <tester ip> -j -c -l 60 -t TCP_MAERTS --
      -k DIRECTION,THROUGHPUT,MEAN_LATENCY,LOCAL_CPU_UTIL,REMOTE_CPU_UTIL,LOCAL_BYTES_SENT,REMOTE_BYTES_RECVD,LOCAL_SEND_SIZE &
done

Running the following commands will trigger netperf clients to measure UDP burst performance for 60 seconds at various burst/datagram sizes and report CPU utilization.

  • For UDP egress tests, run netperf client from DUT and start netserver on tester.

netperf -H <tester ip> -j -c -l 60 -t UDP_STREAM -b <burst_size> -w <wait_time> -- -m <UDP datagram size>
   -k DIRECTION,THROUGHPUT,MEAN_LATENCY,LOCAL_CPU_UTIL,REMOTE_CPU_UTIL,LOCAL_BYTES_SENT,REMOTE_BYTES_RECVD,LOCAL_SEND_SIZE
  • For UDP ingress tests, run netperf client from tester and start netserver on DUT.

netperf -H <DUT ip> -j -C -l 60 -t UDP_STREAM -b <burst_size> -w <wait_time> -- -m <UDP datagram size>
   -k DIRECTION,THROUGHPUT,MEAN_LATENCY,LOCAL_CPU_UTIL,REMOTE_CPU_UTIL,LOCAL_BYTES_SENT,REMOTE_BYTES_RECVD,LOCAL_SEND_SIZE

2.5.1.3.8.1. CPSW/CPSW2g/CPSW3g Ethernet

  • CPSW3g: AM64x

2.5.1.3.8.1.1. TCP Bidirectional Throughput
Table 2.10 CPSW2g TCP Bidirectional Throughput

Command Used

am64xx-hsevm: THROUGHPUT (Mbits/sec)

am64xx-hsevm: CPU Load % (LOCAL_CPU_UTIL)

netperf -H 192.168.0.1 -j -c -C -l 60 -t TCP_STREAM; netperf -H 192.168.0.1 -j -c -C -l 60 -t TCP_MAERTS

1051.83

98.0

2.5.1.3.8.1.2. TCP Bidirectional Throughput Interrupt Pacing
Table 2.11 CPSW2g TCP Bidirectional Throughput Interrupt Pacing

Command Used

am64xx-hsevm: THROUGHPUT (Mbits/sec)

am64xx-hsevm: CPU Load % (LOCAL_CPU_UTIL)

netperf -H 192.168.0.1 -j -c -C -l 60 -t TCP_STREAM; netperf -H 192.168.0.1 -j -c -C -l 60 -t TCP_MAERTS

1141.56

98.7

2.5.1.3.8.1.3. UDP Throughput
Table 2.12 CPSW2g UDP Egress Throughput 0 loss

Frame Size(bytes)

am64xx-hsevm: UDP Datagram Size(bytes) (LOCAL_SEND_SIZE)

am64xx-hsevm: THROUGHPUT (Mbits/sec)

am64xx-hsevm: Packets Per Second (kPPS)

am64xx-hsevm: CPU Load % (LOCAL_CPU_UTIL)

64

44.26

86

87.2

128

84.74

83

87.4

256

168.40

82

90.2

1024

612.56

75

89.4

1518

864.47

73

89.6

Table 2.13 CPSW2g UDP Ingress Throughput 0 loss

Frame Size(bytes)

am64xx-hsevm: UDP Datagram Size(bytes) (LOCAL_SEND_SIZE)

am64xx-hsevm: THROUGHPUT (Mbits/sec)

am64xx-hsevm: Packets Per Second (kPPS)

am64xx-hsevm: CPU Load % (LOCAL_CPU_UTIL)

64

30.77

60

35.0

128

74.65

73

43.7

256

150.12

73

44.4

1024

566.07

69

48.6

1518

876.13

74

66.7

Table 2.14 CPSW2g UDP Ingress Throughput possible loss

Frame Size(bytes)

am64xx-hsevm: UDP Datagram Size(bytes) (LOCAL_SEND_SIZE)

am64xx-hsevm: THROUGHPUT (Mbits/sec)

am64xx-hsevm: Packets Per Second (kPPS)

am64xx-hsevm: CPU Load % (LOCAL_CPU_UTIL)

am64xx-hsevm: Packet Loss %

128

92.68 (min 84.84, max 97.29)

90.50 (min 83.00, max 95.00)

66.28 (min 64.69, max 67.86)

72.37 (min 68.17, max 79.35)

256

190.43 (min 175.08, max 202.24)

93.00 (min 85.00, max 99.00)

67.43 (min 65.94, max 68.79)

69.29 (min 67.47, max 71.90)

1024

586.35 (min 540.95, max 621.28)

71.67 (min 66.00, max 76.00)

66.59 (min 65.50, max 68.59)

30.88 (min 27.41, max 35.21)

1518

634.14 (min 592.61, max 686.45)

53.75 (min 50.00, max 58.00)

65.50 (min 64.50, max 66.73)

32.49 (min 28.27, max 35.88)

2.5.1.3.8.2. ICSSG Ethernet

2.5.1.3.8.2.1. ICSSG TCP Bidirectional Throughput
Table 2.15 ICSSG TCP Bidirectional Throughput

Command Used

am64xx-hsevm: THROUGHPUT (Mbits/sec)

am64xx-hsevm: CPU Load % (LOCAL_CPU_UTIL)

netperf -H 192.168.2.1 -j -c -C -l 60 -t TCP_STREAM; netperf -H 192.168.2.1 -j -c -C -l 60 -t TCP_MAERTS

1073.37

95.6

2.5.1.3.8.2.2. ICSSG TCP Bidirectional Throughput Interrupt Pacing
Table 2.16 ICSSG TCP Bidirectional Throughput Interrupt Pacing

Command Used

am64xx-hsevm: THROUGHPUT (Mbits/sec)

am64xx-hsevm: CPU Load % (LOCAL_CPU_UTIL)

netperf -H 192.168.2.1 -j -c -C -l 60 -t TCP_STREAM; netperf -H 192.168.2.1 -j -c -C -l 60 -t TCP_MAERTS

1039.79

83.8

2.5.1.3.8.2.3. UDP Egress Throughput
Table 2.17 ICSSG UDP Egress Throughput 0 loss

Frame Size(bytes)

am64xx-hsevm: UDP Datagram Size(bytes) (LOCAL_SEND_SIZE)

am64xx-hsevm: THROUGHPUT (Mbits/sec)

am64xx-hsevm: Packets Per Second (kPPS)

am64xx-hsevm: CPU Load % (LOCAL_CPU_UTIL)

64

45.31

88

87.5

128

87.49

85

88.4

256

166.04

81

89.2

1024

610.00

74

89.3

1472

855.64

73

90.1

2.5.1.3.8.2.4. UDP Ingress Throughput
Table 2.18 ICSSG UDP Ingress Throughput 0 loss

Frame Size(bytes)

am64xx-hsevm: UDP Datagram Size(bytes) (LOCAL_SEND_SIZE)

am64xx-hsevm: THROUGHPUT (Mbits/sec)

am64xx-hsevm: Packets Per Second (kPPS)

am64xx-hsevm: CPU Load %

64

36.35

71

44.2

128

70.25

69

47.0

256

138.03

67

45.5

1024

530.84

65

52.5

1472

626.48

53

48.6


2.5.1.3.9. PCIe

2.5.1.3.9.1. PCIe-NVMe-SSD

To run the performance test, connect an NVMe SSD to the PCIe slot of the EVM, and execute the following commands:

cd /opt/ltp
./runltp -P am64xx-hsevm -f ddt/pci_gen3ssd_perf -s "PCI_L_PERF_NVMESSD_EXT4_FIO_10G "
Table 2.19 PCIE SSD EXT4 FIO 10G

Buffer size (bytes)

Write EXT4 Throughput (Mbytes/sec)

Write EXT4 CPU Load (%)

Read EXT4 Throughput (Mbytes/sec)

Read EXT4 CPU Load (%)

1m

397 (min 393.4, max 400.6)

24.39

422 (min 419.0, max 425.9)

15.49

4m

398 (min 385.9, max 411.0)

19.26

424 (min 410.2, max 436.1)

15.11

4k

74.2 (min 71.1, max 76.3)

50.47

103 (min 100.8, max 105.5)

50.78

256k

397 (min 390.3, max 399.3)

25.54

420 (min 416.3, max 422.7)

15.16

  • File size used: 10G

  • FIO command options: –ioengine=’libaio’ –iodepth=4 –numjobs=1 –direct=1 –group_reporting –runtime=60 –time_based –eta=never

  • Platform: Speed 5GT/s, Width x1

  • SSD used: Intel SSDPED1D280GA


2.5.1.3.10. OSPI

2.5.1.3.10.1. OSPI RAW

Table 2.20 OSPI Raw Flash Driver

File size (Mbytes)

am64xx-hsevm: Raw Read Throughput (Mbytes/sec)

50

120.03 (min 34.72, max 142.86)


2.5.1.3.11. EMMC

Warning

IMPORTANT: The performance numbers can be severely affected if the media is mounted in sync mode. Hot plug scripts in the filesystem mount removable media in sync mode to ensure data integrity. For performance sensitive applications, umount the auto-mounted filesystem and re-mount in async mode.

2.5.1.3.11.1. EMMC EXT4 FIO 1G

Table 2.21 EMMC EXT4 FIO 1G

Buffer size (bytes)

am64xx-hsevm: Write EXT4 Throughput (Mbytes/sec)

am64xx-hsevm: Write EXT4 CPU Load (%)

am64xx-hsevm: Read EXT4 Throughput (Mbytes/sec)

am64xx-hsevm: Read EXT4 CPU Load (%)

1m

60.85 (min 59.80, max 61.40)

4.01 (min 3.82, max 4.19)

175.00

7.54 (min 6.84, max 8.58)

4m

60.92 (min 60.10, max 61.70)

3.00 (min 2.94, max 3.09)

175.00

6.21 (min 6.08, max 6.67)

4k

51.03 (min 50.40, max 51.40)

47.71 (min 47.11, max 48.21)

56.20 (min 55.90, max 56.50)

43.39 (min 42.04, max 44.59)

256k

60.88 (min 59.70, max 61.40)

5.90 (min 5.76, max 6.02)

174.00

8.94 (min 8.35, max 9.48)

2.5.1.3.11.2. EMMC EXT4

Table 2.22 EMMC EXT4

Buffer size (bytes)

am64xx-hsevm: Write EXT4 Throughput (Mbytes/sec)

am64xx-hsevm: Write EXT4 CPU Load (%)

am64xx-hsevm: Read EXT4 Throughput (Mbytes/sec)

am64xx-hsevm: Read EXT4 CPU Load (%)

102400

53.52 (min 50.76, max 55.23)

10.85 (min 9.02, max 15.05)

177.10 (min 170.77, max 178.65)

29.75 (min 26.36, max 31.19)

262144

53.44 (min 49.12, max 55.01)

11.09 (min 9.71, max 14.70)

180.91 (min 177.95, max 182.21)

30.50 (min 27.93, max 33.04)

524288

53.65 (min 49.96, max 55.45)

10.94 (min 9.33, max 14.80)

182.81 (min 182.59, max 182.93)

27.26 (min 24.55, max 28.83)

1048576

53.88 (min 49.84, max 55.29)

10.68 (min 9.47, max 14.43)

182.82 (min 182.64, max 182.99)

28.13 (min 25.89, max 29.46)

5242880

54.16 (min 49.90, max 55.64)

10.63 (min 9.14, max 14.63)

182.84 (min 182.76, max 182.90)

27.89 (min 27.03, max 28.57)

2.5.1.3.11.3. EMMC VFAT

Table 2.23 EMMC VFAT

Buffer size (bytes)

am64xx-hsevm: Write VFAT Throughput (Mbytes/sec)

am64xx-hsevm: Write VFAT CPU Load (%)

am64xx-hsevm: Read VFAT Throughput (Mbytes/sec)

am64xx-hsevm: Read VFAT CPU Load (%)

102400

48.54 (min 40.00, max 51.49)

12.98 (min 10.62, max 19.53)

168.22 (min 167.35, max 168.71)

31.87 (min 28.81, max 34.48)

262144

50.03 (min 40.70, max 53.63)

13.61 (min 11.41, max 19.72)

169.22 (min 167.80, max 170.47)

30.98 (min 27.27, max 37.82)

524288

49.42 (min 39.94, max 52.77)

13.40 (min 11.16, max 19.84)

168.08 (min 166.94, max 169.46)

27.37 (min 25.20, max 28.69)

1048576

48.91 (min 40.22, max 51.96)

13.10 (min 10.95, max 19.49)

166.64 (min 165.06, max 168.68)

27.83 (min 25.62, max 28.80)

5242880

49.84 (min 40.55, max 54.04)

13.15 (min 11.19, max 19.67)

166.79 (min 165.93, max 167.42)

28.51 (min 27.87, max 29.03)

2.5.1.3.11.4. UBoot EMMC

Table 2.24 UBOOT EMMC RAW

File size (bytes in hex)

am64xx-hsevm: Write Throughput (Kbytes/sec)

am64xx-hsevm: Read Throughput (Kbytes/sec)

2000000

59848.32 (min 58724.01, max 61134.33)

169053.08 (min 168907.22, max 169782.38)

4000000

60759.37 (min 59308.60, max 61651.93)

172614.84 (min 172463.16, max 172918.21)

2.5.1.3.12. MMCSD

Warning

IMPORTANT: The performance numbers can be severely affected if the media is mounted in sync mode. Hot plug scripts in the filesystem mount removable media in sync mode to ensure data integrity. For performance sensitive applications, umount the auto-mounted filesystem and re-mount in async mode.

2.5.1.3.12.1. MMC EXT4 FIO 1G

Table 2.25 MMC EXT4 FIO 1G

Buffer size (bytes)

am64xx-hsevm: Write EXT4 Throughput (Mbytes/sec)

am64xx-hsevm: Write EXT4 CPU Load (%)

am64xx-hsevm: Read EXT4 Throughput (Mbytes/sec)

am64xx-hsevm: Read EXT4 CPU Load (%)

1m

42.42 (min 41.30, max 44.00)

3.46 (min 3.11, max 3.71)

86.77 (min 84.80, max 87.90)

5.25 (min 5.00, max 5.40)

4m

41.77 (min 40.30, max 42.70)

2.57 (min 2.51, max 2.68)

85.97 (min 82.60, max 87.30)

3.78 (min 3.35, max 4.18)

4k

2.77 (min 2.72, max 2.81)

6.96 (min 6.71, max 7.31)

12.82 (min 12.70, max 12.90)

12.76 (min 12.13, max 13.58)

256k

38.15 (min 37.80, max 38.70)

4.64 (min 4.50, max 4.76)

83.47 (min 83.10, max 83.90)

6.51 (min 6.19, max 7.09)

2.5.1.3.12.2. MMC EXT4

Table 2.26 MMC EXT4

Buffer size (bytes)

am64xx-hsevm: Write Raw Throughput (Mbytes/sec)

am64xx-hsevm: Write Raw CPU Load (%)

am64xx-hsevm: Read Raw Throughput (Mbytes/sec)

am64xx-hsevm: Read Raw CPU Load (%)

102400

28.91 (min 27.03, max 32.81)

5.91 (min 4.58, max 8.99)

39.25 (min 37.68, max 40.92)

7.04 (min 6.25, max 7.95)

262144

28.72 (min 27.22, max 32.30)

6.29 (min 4.81, max 8.97)

41.56 (min 39.87, max 42.87)

6.69 (min 6.28, max 7.44)

524288

29.68 (min 28.38, max 32.45)

6.11 (min 4.99, max 9.66)

45.38 (min 45.00, max 45.57)

6.76 (min 6.05, max 7.38)

1048576

30.06 (min 28.89, max 32.57)

6.01 (min 4.93, max 8.69)

45.34 (min 45.16, max 45.45)

6.75 (min 6.33, max 7.17)

5242880

31.13 (min 28.88, max 33.47)

6.14 (min 4.65, max 9.08)

45.36 (min 45.00, max 45.55)

6.87 (min 6.37, max 7.21)

The performance numbers were captured using the following:

  • SanDisk Max Endurance SD card (SDSQQVR-032G-GN6IA)

  • Partition was mounted with async option


2.5.1.3.13. CRYPTO

2.5.1.3.13.1. OpenSSL Performance

Table 2.27 OpenSSL Performance

Algorithm

Buffer Size (in bytes)

am64xx-hsevm: throughput (KBytes/Sec)

aes-128-cbc

1024

23012.35

aes-128-cbc

16

345.75

aes-128-cbc

16384

138062.51

aes-128-cbc

256

5988.95

aes-128-cbc

64

1506.60

aes-128-cbc

8192

100433.92

aes-128-ecb

1024

22891.52

aes-128-ecb

16

345.72

aes-128-ecb

16384

144796.33

aes-128-ecb

256

5978.97

aes-128-ecb

64

1483.33

aes-128-ecb

8192

105411.93

aes-192-cbc

1024

22946.13

aes-192-cbc

16

322.59

aes-192-cbc

16384

130547.71

aes-192-cbc

256

5987.33

aes-192-cbc

64

1483.73

aes-192-cbc

8192

96985.09

aes-192-ecb

1024

23038.29

aes-192-ecb

16

323.43

aes-192-ecb

16384

132852.39

aes-192-ecb

256

5995.86

aes-192-ecb

64

1401.62

aes-192-ecb

8192

100335.62

aes-256-cbc

1024

20581.72

aes-256-cbc

16

320.95

aes-256-cbc

16384

122339.33

aes-256-cbc

256

5605.12

aes-256-cbc

64

1392.06

aes-256-cbc

8192

92940.97

aes-256-ecb

1024

21534.04

aes-256-ecb

16

326.69

aes-256-ecb

16384

127320.06

aes-256-ecb

256

5676.46

aes-256-ecb

64

1498.28

aes-256-ecb

8192

97176.23

sha256

1024

24602.62

sha256

16

407.77

sha256

16384

206176.26

sha256

256

6433.96

sha256

64

1622.78

sha256

8192

137366.19

sha512

1024

20061.53

sha512

16

393.69

sha512

16384

79216.64

sha512

256

5904.04

sha512

64

1574.76

sha512

8192

65959.25

Table 2.28 OpenSSL CPU Load

Algorithm

am64xx-hsevm: CPU Load

aes-128-cbc

44.00

aes-128-ecb

45.00

aes-192-cbc

43.00

aes-192-ecb

44.00

aes-256-cbc

42.00

aes-256-ecb

43.00

sha256

94.00

sha512

94.00

Listed for each algorithm are the code snippets used to run each benchmark test.

time -v openssl speed -elapsed -evp aes-128-cbc

2.5.1.3.13.2. RP Message Inter-Processor Communication (IPC) Latency

2.5.1.3.13.2.1. RP Message latency Performance

RP Message latency is the delay measured from sending a round trip echo message from a Linux application to a remote processor and back. The following measurements use a RP message length of 1 byte and 490 bytes for comparison.

The Linux user space application rpmsg_char_benchmark captures these latency values.

Test commands used for running IPC latency tests:

rpmsg_char_benchmark -r 2 -n 100000 -m 1 & chrt -f -p 80 $!

Latencies reported:

Remote Processor

Message Size (in bytes)

Average round trip (usecs)

Max round trip (usecs)

R5F0_0

1

35

194

R5F0_0

490

154

255

M4F

1

43

162

M4F

490

282

439

../../../_images/R5_0_0_m1_ipc_latency.png ../../../_images/R5_0_0_m490_ipc_latency.png ../../../_images/m4_0_m1_ipc_latency.png ../../../_images/m4_0_m490_ipc_latency.png