Hi Stanislav,

You are welcome.

Thanks for spotting, and you are right, the af_xdp driver numbers did a nose 
dive indeed.
It’s visible on xeon skylake per your link references, and also on:
- intel xeon cascadelake [2], [3],
- arm thunderx2 [4].

Comparison tables [5], [6] provide a proof that the drop is due to CSIT test 
environment change from v7 to v8 [7], and unlikely due to VPP code.
We need to investigate.

Hope this makes sense.

Cheers,
Maciek

[2] 
https://s3-docs.fd.io/csit/rls2110/report/vpp_performance_tests/packet_throughput_graphs/ip4-2n-clx-xxv710.html#b-2t1c-ip4routing-base-scale-af-xdp
[3] 
https://docs.fd.io/csit/rls2106/report/vpp_performance_tests/packet_throughput_graphs/ip4-2n-clx-xxv710.html#b-2t1c-ip4routing-base-scale-af-xdp
[4] 
https://s3-docs.fd.io/csit/rls2110/report/vpp_performance_tests/packet_throughput_graphs/ip4-2n-tx2-xl710.html#b-1t1c-ip4routing-base-scale-af-xdp
[5] search for “af-xdp” in 
https://s3-docs.fd.io/csit/rls2110/report/_static/vpp/performance-changes-2n-skx-2t1c-pdr.txt
[6] 
https://s3-docs.fd.io/csit/rls2110/report/vpp_performance_tests/comparisons/current_vs_previous_release.html
[7] 
https://s3-docs.fd.io/csit/rls2110/report/vpp_performance_tests/test_environment.html#environment-versioning

On 11 Nov 2021, at 14:47, Stanislav Zaikin 
<zsta...@gmail.com<mailto:zsta...@gmail.com>> wrote:

Thanks for the report!
Out of curiosity, what happened to AF_XDP? PPS rate was much bigger on r21.06.

[0] - 
https://s3-docs.fd.io/csit/rls2110/report/vpp_performance_tests/packet_throughput_graphs/ip4-2n-skx-x710.html
[1] - 
https://docs.fd.io/csit/rls2106/report/vpp_performance_tests/packet_throughput_graphs/ip4-2n-skx-x710.html

On Thu, 11 Nov 2021 at 15:19, Maciek Konstantynowicz (mkonstan) via 
lists.fd.io<http://lists.fd.io/> 
<mkonstan=cisco....@lists.fd.io<mailto:cisco....@lists.fd.io>> wrote:
Big thanks to FD.io<http://fd.io/> community contributors and supporters that 
enabled this data-rich publication.
Great job everyone!

Cheers,
Maciek

On 10 Nov 2021, at 18:12, Tibor Frank via lists.fd.io<http://lists.fd.io/> 
<tifrank=cisco....@lists.fd.io<mailto:tifrank=cisco....@lists.fd.io>> wrote:

Hi All,

FD.io<http://fd.io/> CSIT-2110 report is now available on FD.io<http://fd.io/> 
docs site:

https://s3-docs.fd.io/csit/rls2110/report/

Another successful release! Many thanks to all contributors in CSIT and
VPP communities for making it happen.

See below for CSIT-2110 release summary and pointers to specific
sections in the report.

Welcome all comments, best by email to 
csit-...@lists.fd.io<mailto:csit-...@lists.fd.io>.

Tibor


CSIT-2110 Release Summary
-------------------------

BENCHMARK TESTS

- Intel Xeon Ice Lake: Added test data for these platforms. Current CSIT-2110
  report data for Intel Xeon Ice Lake comes from an external source (Intel
  labs running CSIT code on “8360Y D Stepping” and “6338N” processors).

- MLRsearch improvements: Added support for multiple packet throughput rates
  in a single search, each rate is associated with a distinct Packet Loss Ratio
  (PLR) criterion. Previously only Non Drop Rate (NDR) (PLR=0) and single
  Partial Drop Rate (PDR) (PLR<0.5%) were supported. Implemented number of
  optimizations improving rate discovery efficiency.

- TREX performance tests: Added initial tests for testing latency between 2
  ports on nic on the TRex. Added tests: IP4Base, IP4scale2m, IP6Base,
  IP6scale2m, L2bscale1mmaclrn.

TEST FRAMEWORK

- CSIT test environment version has been updated to ver. 8: Intel NIC 700/800
  series firmware upgrade based on DPDK compatibility matrix.

- CSIT in AWS environment: Added CSIT support for AWS c5n instances
  environment.

Pointers to CSIT-2110 Report sections
-------------------------------------

1. FD.io<http://fd.io/> CSIT test methodology          [1]
2. VPP release notes                    [2]
3. VPP 64B/IMIX throughput graphs       [3]
4. VPP throughput speedup multi-core    [4]
5. VPP latency under load               [5]
6. VPP comparisons v21.10 vs. v21.06    [6]
7. VPP performance all pkt sizes & NICs [7]
8. DPDK 21.08 apps release notes        [8]
9. DPDK 64B throughput graphs           [9]
10. DPDK latency under load             [10]
11. DPDK comparisons 21.08 vs. 21.02    [11]
12. TRex 2.88 apps release notes        [12]
13. TRex 64B throughput graphs          [13]
14. TRex latency under load             [14]

Functional device tests (VPP_Device) are also included in the report.

[1] https://s3-docs.fd.io/csit/rls2110/report/introduction/methodology.html
[2] 
https://s3-docs.fd.io/csit/rls2110/report/vpp_performance_tests/csit_release_notes.html
[3] 
https://s3-docs.fd.io/csit/rls2110/report/vpp_performance_tests/packet_throughput_graphs/index.html
[4] 
https://s3-docs.fd.io/csit/rls2110/report/vpp_performance_tests/throughput_speedup_multi_core/index.html
[5] 
https://s3-docs.fd.io/csit/rls2110/report/vpp_performance_tests/packet_latency/index.html
[6] 
https://s3-docs.fd.io/csit/rls2110/report/vpp_performance_tests/comparisons/current_vs_previous_release.html
[7] 
https://s3-docs.fd.io/csit/rls2110/report/detailed_test_results/vpp_performance_results/index.html
[8] 
https://s3-docs.fd.io/csit/rls2110/report/dpdk_performance_tests/csit_release_notes.html
[9] 
https://s3-docs.fd.io/csit/rls2110/report/dpdk_performance_tests/packet_throughput_graphs/index.html
[10] 
https://s3-docs.fd.io/csit/rls2110/report/dpdk_performance_tests/packet_latency/index.html
[11] 
https://s3-docs.fd.io/csit/rls2110/report/dpdk_performance_tests/comparisons/current_vs_previous_release.html
[12] 
https://s3-docs.fd.io/csit/rls2110/report/trex_performance_tests/csit_release_notes.html
[13] 
https://s3-docs.fd.io/csit/rls2110/report/trex_performance_tests/packet_throughput_graphs/index.html
[14] 
https://s3-docs.fd.io/csit/rls2110/report/trex_performance_tests/packet_latency/index.html









--
Best regards
Stanislav Zaikin




-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#20482): https://lists.fd.io/g/vpp-dev/message/20482
Mute This Topic: https://lists.fd.io/mt/86982560/21656
Group Owner: vpp-dev+ow...@lists.fd.io
Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub [arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-

Reply via email to