Update: CSIT-2001.09 maintenance report has been published:
https://docs.fd.io/csit/rls2001/report/
Changes from last week version include:
Added VPP performance test data into Detailed Results per testbed types:
- 2n-clx (Xeon Cascadelake): IPv4, IPv6, L2.
- 2n-dnv (Atom Denverton): IPsec, IPv4 tunnels.
- 3n-hsw (Xeon Haswell): IPv4, L2, vhost.
Added VPP performance tests selected for analysis and graphs per testbed
types:
- 2n-clx (Xeon Cascadelake): all tests.
- 3n-tsh (Arm Cortex-A72 Taishan): all tests.
Added DPDK performance tests selected for analysis and graphs per testbed
types:
- 2n-clx (Xeon Cascadelake): all tests.
2n-skx and 3n-skx testbeds (Xeon Skylake) are still out of service due to the
processor microcode issue.
For status see:
https://docs.fd.io/csit/rls2001/report/vpp_performance_tests/csit_release_notes.html
https://docs.fd.io/csit/rls2001/report/dpdk_performance_tests/csit_release_notes.html
Welcome all comments, best by email to
csit-...@lists.fd.io<mailto:csit-...@lists.fd.io>.
Cheers,
-Maciek
On 14 Feb 2020, at 14:02, Maciek Konstantynowicz (mkonstan)
<mkons...@cisco.com<mailto:mkons...@cisco.com>> wrote:
Hi All,
FD.io<http://FD.io> CSIT-2001 report has been published on FD.io<http://FD.io>
docs site:
https://docs.fd.io/csit/rls2001/report/
Many thanks to All in CSIT, VPP and wider FD.io<http://FD.io> community who
contributed and worked hard to make CSIT-2001 happen!
Below three summaries:
- Intel Xeon 2n-skx, 3n-skx and 2n-clx Testbeds microcode issue.
- CSIT-2001 Release Summary, a high-level summary.
- Points of Note in CSIT-2001 Report, with specific links to report.
Welcome all comments, best by email to
csit-...@lists.fd.io<mailto:csit-...@lists.fd.io>.
Cheers,
-Maciek
------------------------------------------------------------------------
NOTE: Intel Xeon 2n-skx, 3n-skx and 2n-clx Testbeds microcode issue.
------------------------------------------------------------------------
VPP and DPDK performance test data is not included in this report
version. This is due to the lower performance and behaviour
inconsistency of these systems following the upgrade of processor
microcode packages (skx ucode 0x2000064, clx ucode 0x500002c), done
as part of updating Ubuntu 18.04 LTS kernel version. Tested VPP and
DPDK applications (L3fwd) are affected. Skx and Clx test data will
be added in subsequent maintenance report version(s) once the issue
is resolved. See https://jira.fd.io/browse/CSIT-1675.
------------------------------------------------------------------------
CSIT-2001 Release Summary
------------------------------------------------------------------------
1. CSIT-2001 Report
- html link: https://docs.fd.io/csit/rls2001/report/
- pdf link:
https://docs.fd.io/csit/rls2001/report/_static/archive/csit_rls2001.pdf
2. New Tests
- NFV density tests with IPsec encryption between DUTs.
- Full test coverage for VPP AVF driver for Fortville NICs.
- VPP Hoststack TCP/IP tests with wrk, iperf3 with LDPreload tests
without and with packet loss via VPP NSIM plugin), and QUIC/UDP/IP
transport tests.
- Mellanox ConnectX5-2p100GE NICs in 2n-clx testbeds using VPP native
rdma driver.
- Load Balancer tests.
3. Benchmarking
- Fully onboarded new Intel Xeon Cascadelake Testbeds with x710,
xxv710 and mcx556a-edat NIC cards.
- Added new High Dynamic Range Histogram latency measurements.
4. Infrastructure
- Full migration of CSIT from Python2.7 to Python3.6.
------------------------------------------------------------------------
Points of Note in the CSIT-2001 Report
------------------------------------------------------------------------
Indexed specific links listed at the bottom.
1. VPP release notes
a. Changes in CSIT-2001: [1]
b. Known issues: [2]
2. VPP performance - 64B/IMIX throughput graphs (selected NIC models):
a. Graphs explained: [3]
b. L2 Ethernet Switching: [4]
c. IPv4 Routing: [5]
d. IPv6 Routing: [6]
e. SRv6 Routing: [7]
f. IPv4 Tunnels: [8]
g. KVM VMs vhost-user: [9]
h. LXC/DRC Container Memif: [10]
e. IPsec IPv4 Routing: [11]
f. Virtual Topology System: [12]
3. VPP performance - multi-core and latency graphs:
a. Speedup Multi-Core: [13]
b. Latency: [14]
4. VPP performance comparisons
a. VPP-20.01 vs. VPP-19.08: [15]
5. VPP performance test details - all NICs:
a. Detailed results 64B IMIX 1518B 9kB: [16]
b. Configuration: [17]
DPDK Testpmd and L3fwd performance sections follow similar structure.
6. DPDK applications:
a. Release notes: [18]
b. DPDK performance - 64B throughput graphs: [19]
c. DPDK performance - latency graphs: [20]
d. DPDK performance - DPDK-19.08 vs. DPDK-19.05: [21]
Functional tests, including VPP_Device (functional device tests),
VPP_VIRL and HoneyComb are all included in the report.
Specific links within the report:
[1]
https://docs.fd.io/csit/rls2001/report/vpp_performance_tests/csit_release_notes.html#changes-in-csit-release
[2]
https://docs.fd.io/csit/rls2001/report/vpp_performance_tests/csit_release_notes.html#known-issues
[3]
https://docs.fd.io/csit/rls2001/report/vpp_performance_tests/packet_throughput_graphs/index.html
[4]
https://docs.fd.io/csit/rls2001/report/vpp_performance_tests/packet_throughput_graphs/l2.html
[5]
https://docs.fd.io/csit/rls2001/report/vpp_performance_tests/packet_throughput_graphs/ip4.html
[6]
https://docs.fd.io/csit/rls2001/report/vpp_performance_tests/packet_throughput_graphs/ip6.html
[7]
https://docs.fd.io/csit/rls2001/report/vpp_performance_tests/packet_throughput_graphs/srv6.html
[8]
https://docs.fd.io/csit/rls2001/report/vpp_performance_tests/packet_throughput_graphs/ip4_tunnels.html
[9]
https://docs.fd.io/csit/rls2001/report/vpp_performance_tests/packet_throughput_graphs/vm_vhost.html
[10]
https://docs.fd.io/csit/rls2001/report/vpp_performance_tests/packet_throughput_graphs/container_memif.html
[11]
https://docs.fd.io/csit/rls2001/report/vpp_performance_tests/packet_throughput_graphs/ipsec.html
[12]
https://docs.fd.io/csit/rls2001/report/vpp_performance_tests/packet_throughput_graphs/vts.html
[13]
https://docs.fd.io/csit/rls2001/report/vpp_performance_tests/throughput_speedup_multi_core/index.html
[14]
https://docs.fd.io/csit/rls2001/report/vpp_performance_tests/packet_latency/index.html
[15]
https://docs.fd.io/csit/rls2001/report/vpp_performance_tests/comparisons/current_vs_previous_release.html
[16]
https://docs.fd.io/csit/rls2001/report/detailed_test_results/vpp_performance_results/index.html
[17]
https://docs.fd.io/csit/rls2001/report/test_configuration/vpp_performance_configuration/index.html
[18]
https://docs.fd.io/csit/rls2001/report/dpdk_performance_tests/csit_release_notes.html
[19]
https://docs.fd.io/csit/rls2001/report/dpdk_performance_tests/packet_throughput_graphs/index.html
[20]
https://docs.fd.io/csit/rls2001/report/dpdk_performance_tests/packet_latency/index.html
[21]
https://docs.fd.io/csit/rls2001/report/dpdk_performance_tests/comparisons/current_vs_previous_release.html
------------------------------------------------------------------------
-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#15598): https://lists.fd.io/g/vpp-dev/message/15598
Mute This Topic: https://lists.fd.io/mt/71591979/21656
Group Owner: vpp-dev+ow...@lists.fd.io
Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub [arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-
