Re: [vpp-dev] [csit-dev] FD.io CSIT-2110 Release Report is published

2021-11-14 Thread Ameen Al-Azzawi 
Dear Maciek,

I have just sent another email with more details regarding the issue.

Regards
Ameen

On Thu, Nov 11, 2021 at 4:39 PM Maciek Konstantynowicz (mkonstan) <
mkons...@cisco.com> wrote:

> Dear Ameen,
>
> What specific statement in the email do you disagree with?
>
> This is not a research paper, it is FD.io CSIT release report capturing
> benchmarking and functional test data for v21.10 release.
>
> Regarding your comment about "VPP and the system doesn't function”, I
> checked your statement about:
>
> "I have asked here a million times about configuring ds-lite, no one
> helped.”
>
> And found out that you have sent few emails (between 26-Sep and 28-Oct) to
> vpp-dev with questions about running ds-lite on vpp, and the last email was
> not answered.
> I suggest you resend the email, and I am confident that FD.io dev
> community will provide you with support.
>
> Cheers,
> Maciek
>
>
> On 11 Nov 2021, at 14:22, Ameen Al-Azzawi  wrote:
>
> I would totally disagree.
> It is disappointing when you base your research paper on VPP and the
> system doesn't function.
> I have asked here a million times about configuring ds-lite, no one
> helped.
>
> On Thu, Nov 11, 2021 at 3:19 PM Maciek Konstantynowicz (mkonstan) via
> lists.fd.io  wrote:
>
>> Big thanks to FD.io  community contributors and
>> supporters that enabled this data-rich publication.
>> Great job everyone!
>>
>> Cheers,
>> Maciek
>>
>> On 10 Nov 2021, at 18:12, Tibor Frank via lists.fd.io <
>> tifrank=cisco@lists.fd.io> wrote:
>>
>> Hi All,
>>
>> FD.io  CSIT-2110 report is now available on FD.io
>>  docs site:
>>
>> https://s3-docs.fd.io/csit/rls2110/report/
>>
>> Another successful release! Many thanks to all contributors in CSIT and
>> VPP communities for making it happen.
>>
>> See below for CSIT-2110 release summary and pointers to specific
>> sections in the report.
>>
>> Welcome all comments, best by email to csit-...@lists.fd.io.
>>
>> Tibor
>>
>>
>> CSIT-2110 Release Summary
>> -
>>
>> BENCHMARK TESTS
>>
>> - Intel Xeon Ice Lake: Added test data for these platforms. Current
>> CSIT-2110
>>   report data for Intel Xeon Ice Lake comes from an external source (Intel
>>   labs running CSIT code on “8360Y D Stepping” and “6338N” processors).
>>
>> - MLRsearch improvements: Added support for multiple packet throughput
>> rates
>>   in a single search, each rate is associated with a distinct Packet Loss
>> Ratio
>>   (PLR) criterion. Previously only Non Drop Rate (NDR) (PLR=0) and single
>>   Partial Drop Rate (PDR) (PLR<0.5%) were supported. Implemented number of
>>   optimizations improving rate discovery efficiency.
>>
>> - TREX performance tests: Added initial tests for testing latency between
>> 2
>>   ports on nic on the TRex. Added tests: IP4Base, IP4scale2m, IP6Base,
>>   IP6scale2m, L2bscale1mmaclrn.
>>
>> TEST FRAMEWORK
>>
>> - CSIT test environment version has been updated to ver. 8: Intel NIC
>> 700/800
>>   series firmware upgrade based on DPDK compatibility matrix.
>>
>> - CSIT in AWS environment: Added CSIT support for AWS c5n instances
>>   environment.
>>
>> Pointers to CSIT-2110 Report sections
>> -
>>
>> 1. FD.io  CSIT test methodology  [1]
>> 2. VPP release notes[2]
>> 3. VPP 64B/IMIX throughput graphs   [3]
>> 4. VPP throughput speedup multi-core[4]
>> 5. VPP latency under load   [5]
>> 6. VPP comparisons v21.10 vs. v21.06[6]
>> 7. VPP performance all pkt sizes & NICs [7]
>> 8. DPDK 21.08 apps release notes[8]
>> 9. DPDK 64B throughput graphs   [9]
>> 10. DPDK latency under load [10]
>> 11. DPDK comparisons 21.08 vs. 21.02[11]
>> 12. TRex 2.88 apps release notes[12]
>> 13. TRex 64B throughput graphs  [13]
>> 14. TRex latency under load [14]
>>
>> Functional device tests (VPP_Device) are also included in the report.
>>
>> [1]
>> https://s3-docs.fd.io/csit/rls2110/report/introduction/methodology.html
>> [2]
>> https://s3-docs.fd.io/csit/rls2110/report/vpp_performance_tests/csit_release_notes.html
>> [3]
>> https://s3-docs.fd.io/csit/rls2110/report/vpp_performance_tests/packet_throughput_graphs/index.html
>> [4]
>> https://s3-docs.fd.io/csit/rls2110/report/vpp_performance_tests/throughput_speedup_multi_core/index.html
>> [5]
>> https://s3-docs.fd.io/csit/rls2110/report/vpp_performance_tests/packet_latency/index.html
>> [6]
>> https://s3-docs.fd.io/csit/rls2110/report/vpp_performance_tests/comparisons/current_vs_previous_release.html
>> [7]
>> https://s3-docs.fd.io/csit/rls2110/report/detailed_test_results/vpp_performance_results/index.html
>> [8]
>> https://s3-docs.fd.io/csit/rls2110/report/dpdk_performance_tests/csit_release_notes.html
>> [9]
>> https://s3-docs.fd.io/csit/rls2110/report/dpdk_performance_tests/packet_throughput_graphs/index.html
>> [10]
>>

Re: [vpp-dev] [csit-dev] FD.io CSIT-2110 Release Report is published

2021-11-12 Thread Maciek Konstantynowicz (mkonstan) via lists.fd.io 
Dear Ameen, pls see inline.

On 11 Nov 2021, at 20:19, Ameen Al-Azzawi 
mailto:ameen.azz...@gmail.com>> wrote:

Dear Maciek,

I didn't mean to be rude, but you know how it feels when you see a community of 
professionals for specific software and no one could help.

Understand.

I know that no one is obliged to help me, I was simply expecting more out of it.

My read is that folks are simply very busy, and number of people versed in 
ds-lite and other softwire technologies that VPP implements aplenty of, is not 
that large. So pls bear with this community, and keep trying. Someone wise once 
said "Energy and (constructive) persistence conquer all things”, especially 
when done with conviction of being right ;)

Cheers,
Maciek


Regards
Ameen

On Thu, Nov 11, 2021 at 4:39 PM Maciek Konstantynowicz (mkonstan) 
mailto:mkons...@cisco.com>> wrote:
Dear Ameen,

What specific statement in the email do you disagree with?

This is not a research paper, it is FD.io CSIT release report 
capturing benchmarking and functional test data for v21.10 release.

Regarding your comment about "VPP and the system doesn't function”, I checked 
your statement about:

"I have asked here a million times about configuring ds-lite, no one helped.”

And found out that you have sent few emails (between 26-Sep and 28-Oct) to 
vpp-dev with questions about running ds-lite on vpp, and the last email was not 
answered.
I suggest you resend the email, and I am confident that FD.io 
dev community will provide you with support.

Cheers,
Maciek


On 11 Nov 2021, at 14:22, Ameen Al-Azzawi 
mailto:ameen.azz...@gmail.com>> wrote:

I would totally disagree.
It is disappointing when you base your research paper on VPP and the system 
doesn't function.
I have asked here a million times about configuring ds-lite, no one helped.

On Thu, Nov 11, 2021 at 3:19 PM Maciek Konstantynowicz (mkonstan) via 
lists.fd.io 
mailto:cisco@lists.fd.io>> wrote:
Big thanks to FD.io community contributors and supporters that 
enabled this data-rich publication.
Great job everyone!

Cheers,
Maciek

On 10 Nov 2021, at 18:12, Tibor Frank via lists.fd.io 
mailto:tifrank=cisco@lists.fd.io>> wrote:

Hi All,

FD.io CSIT-2110 report is now available on FD.io 
docs site:

https://s3-docs.fd.io/csit/rls2110/report/

Another successful release! Many thanks to all contributors in CSIT and
VPP communities for making it happen.

See below for CSIT-2110 release summary and pointers to specific
sections in the report.

Welcome all comments, best by email to 
csit-...@lists.fd.io.

Tibor


CSIT-2110 Release Summary
-

BENCHMARK TESTS

- Intel Xeon Ice Lake: Added test data for these platforms. Current CSIT-2110
  report data for Intel Xeon Ice Lake comes from an external source (Intel
  labs running CSIT code on “8360Y D Stepping” and “6338N” processors).

- MLRsearch improvements: Added support for multiple packet throughput rates
  in a single search, each rate is associated with a distinct Packet Loss Ratio
  (PLR) criterion. Previously only Non Drop Rate (NDR) (PLR=0) and single
  Partial Drop Rate (PDR) (PLR<0.5%) were supported. Implemented number of
  optimizations improving rate discovery efficiency.

- TREX performance tests: Added initial tests for testing latency between 2
  ports on nic on the TRex. Added tests: IP4Base, IP4scale2m, IP6Base,
  IP6scale2m, L2bscale1mmaclrn.

TEST FRAMEWORK

- CSIT test environment version has been updated to ver. 8: Intel NIC 700/800
  series firmware upgrade based on DPDK compatibility matrix.

- CSIT in AWS environment: Added CSIT support for AWS c5n instances
  environment.

Pointers to CSIT-2110 Report sections
-

1. FD.io CSIT test methodology  [1]
2. VPP release notes[2]
3. VPP 64B/IMIX throughput graphs   [3]
4. VPP throughput speedup multi-core[4]
5. VPP latency under load   [5]
6. VPP comparisons v21.10 vs. v21.06[6]
7. VPP performance all pkt sizes & NICs [7]
8. DPDK 21.08 apps release notes[8]
9. DPDK 64B throughput graphs   [9]
10. DPDK latency under load [10]
11. DPDK comparisons 21.08 vs. 21.02[11]
12. TRex 2.88 apps release notes[12]
13. TRex 64B throughput graphs  [13]
14. TRex latency under load [14]

Functional device tests (VPP_Device) are also included in the report.

[1] https://s3-docs.fd.io/csit/rls2110/report/introduction/methodology.html
[2] 
https://s3-docs.fd.io/csit/rls2110/report/vpp_performance_tests/csit_release_notes.html
[3] 
https://s3-docs.fd.io/csit/rls2110/report/vpp_performance_tests/packet_throughput_graphs/index.html
[4] 
https://s3-docs.fd.io/csit/rls2110/report/vpp_performance_tests/throughput_speedup_multi_core/index.html
[5]

Re: [vpp-dev] [csit-dev] FD.io CSIT-2110 Release Report is published

2021-11-11 Thread Ameen Al-Azzawi 
Dear Maciek,

I didn't mean to be rude, but you know how it feels when you see a
community of professionals for specific software and no one could help.
I know that no one is obliged to help me, I was simply expecting more out
of it.

Regards
Ameen

On Thu, Nov 11, 2021 at 4:39 PM Maciek Konstantynowicz (mkonstan) <
mkons...@cisco.com> wrote:

> Dear Ameen,
>
> What specific statement in the email do you disagree with?
>
> This is not a research paper, it is FD.io CSIT release report capturing
> benchmarking and functional test data for v21.10 release.
>
> Regarding your comment about "VPP and the system doesn't function”, I
> checked your statement about:
>
> "I have asked here a million times about configuring ds-lite, no one
> helped.”
>
> And found out that you have sent few emails (between 26-Sep and 28-Oct) to
> vpp-dev with questions about running ds-lite on vpp, and the last email was
> not answered.
> I suggest you resend the email, and I am confident that FD.io dev
> community will provide you with support.
>
> Cheers,
> Maciek
>
>
> On 11 Nov 2021, at 14:22, Ameen Al-Azzawi  wrote:
>
> I would totally disagree.
> It is disappointing when you base your research paper on VPP and the
> system doesn't function.
> I have asked here a million times about configuring ds-lite, no one
> helped.
>
> On Thu, Nov 11, 2021 at 3:19 PM Maciek Konstantynowicz (mkonstan) via
> lists.fd.io  wrote:
>
>> Big thanks to FD.io  community contributors and
>> supporters that enabled this data-rich publication.
>> Great job everyone!
>>
>> Cheers,
>> Maciek
>>
>> On 10 Nov 2021, at 18:12, Tibor Frank via lists.fd.io <
>> tifrank=cisco@lists.fd.io> wrote:
>>
>> Hi All,
>>
>> FD.io  CSIT-2110 report is now available on FD.io
>>  docs site:
>>
>> https://s3-docs.fd.io/csit/rls2110/report/
>>
>> Another successful release! Many thanks to all contributors in CSIT and
>> VPP communities for making it happen.
>>
>> See below for CSIT-2110 release summary and pointers to specific
>> sections in the report.
>>
>> Welcome all comments, best by email to csit-...@lists.fd.io.
>>
>> Tibor
>>
>>
>> CSIT-2110 Release Summary
>> -
>>
>> BENCHMARK TESTS
>>
>> - Intel Xeon Ice Lake: Added test data for these platforms. Current
>> CSIT-2110
>>   report data for Intel Xeon Ice Lake comes from an external source (Intel
>>   labs running CSIT code on “8360Y D Stepping” and “6338N” processors).
>>
>> - MLRsearch improvements: Added support for multiple packet throughput
>> rates
>>   in a single search, each rate is associated with a distinct Packet Loss
>> Ratio
>>   (PLR) criterion. Previously only Non Drop Rate (NDR) (PLR=0) and single
>>   Partial Drop Rate (PDR) (PLR<0.5%) were supported. Implemented number of
>>   optimizations improving rate discovery efficiency.
>>
>> - TREX performance tests: Added initial tests for testing latency between
>> 2
>>   ports on nic on the TRex. Added tests: IP4Base, IP4scale2m, IP6Base,
>>   IP6scale2m, L2bscale1mmaclrn.
>>
>> TEST FRAMEWORK
>>
>> - CSIT test environment version has been updated to ver. 8: Intel NIC
>> 700/800
>>   series firmware upgrade based on DPDK compatibility matrix.
>>
>> - CSIT in AWS environment: Added CSIT support for AWS c5n instances
>>   environment.
>>
>> Pointers to CSIT-2110 Report sections
>> -
>>
>> 1. FD.io  CSIT test methodology  [1]
>> 2. VPP release notes[2]
>> 3. VPP 64B/IMIX throughput graphs   [3]
>> 4. VPP throughput speedup multi-core[4]
>> 5. VPP latency under load   [5]
>> 6. VPP comparisons v21.10 vs. v21.06[6]
>> 7. VPP performance all pkt sizes & NICs [7]
>> 8. DPDK 21.08 apps release notes[8]
>> 9. DPDK 64B throughput graphs   [9]
>> 10. DPDK latency under load [10]
>> 11. DPDK comparisons 21.08 vs. 21.02[11]
>> 12. TRex 2.88 apps release notes[12]
>> 13. TRex 64B throughput graphs  [13]
>> 14. TRex latency under load [14]
>>
>> Functional device tests (VPP_Device) are also included in the report.
>>
>> [1]
>> https://s3-docs.fd.io/csit/rls2110/report/introduction/methodology.html
>> [2]
>> https://s3-docs.fd.io/csit/rls2110/report/vpp_performance_tests/csit_release_notes.html
>> [3]
>> https://s3-docs.fd.io/csit/rls2110/report/vpp_performance_tests/packet_throughput_graphs/index.html
>> [4]
>> https://s3-docs.fd.io/csit/rls2110/report/vpp_performance_tests/throughput_speedup_multi_core/index.html
>> [5]
>> https://s3-docs.fd.io/csit/rls2110/report/vpp_performance_tests/packet_latency/index.html
>> [6]
>> https://s3-docs.fd.io/csit/rls2110/report/vpp_performance_tests/comparisons/current_vs_previous_release.html
>> [7]
>> https://s3-docs.fd.io/csit/rls2110/report/detailed_test_results/vpp_performance_results/index.html
>> [8]
>> https://s3-docs.fd.io/csit/rls2110/report/dpdk_performance_tests/csit_release_notes.html
>>

Re: [vpp-dev] [csit-dev] FD.io CSIT-2110 Release Report is published

2021-11-11 Thread Maciek Konstantynowicz (mkonstan) via lists.fd.io 
Dear Ameen,

What specific statement in the email do you disagree with?

This is not a research paper, it is FD.io CSIT release report 
capturing benchmarking and functional test data for v21.10 release.

Regarding your comment about "VPP and the system doesn't function”, I checked 
your statement about:

"I have asked here a million times about configuring ds-lite, no one helped.”

And found out that you have sent few emails (between 26-Sep and 28-Oct) to 
vpp-dev with questions about running ds-lite on vpp, and the last email was not 
answered.
I suggest you resend the email, and I am confident that FD.io dev 
community will provide you with support.

Cheers,
Maciek


On 11 Nov 2021, at 14:22, Ameen Al-Azzawi 
mailto:ameen.azz...@gmail.com>> wrote:

I would totally disagree.
It is disappointing when you base your research paper on VPP and the system 
doesn't function.
I have asked here a million times about configuring ds-lite, no one helped.

On Thu, Nov 11, 2021 at 3:19 PM Maciek Konstantynowicz (mkonstan) via 
lists.fd.io 
mailto:cisco@lists.fd.io>> wrote:
Big thanks to FD.io community contributors and supporters that 
enabled this data-rich publication.
Great job everyone!

Cheers,
Maciek

On 10 Nov 2021, at 18:12, Tibor Frank via lists.fd.io 
mailto:tifrank=cisco@lists.fd.io>> wrote:

Hi All,

FD.io CSIT-2110 report is now available on FD.io 
docs site:

https://s3-docs.fd.io/csit/rls2110/report/

Another successful release! Many thanks to all contributors in CSIT and
VPP communities for making it happen.

See below for CSIT-2110 release summary and pointers to specific
sections in the report.

Welcome all comments, best by email to 
csit-...@lists.fd.io.

Tibor


CSIT-2110 Release Summary
-

BENCHMARK TESTS

- Intel Xeon Ice Lake: Added test data for these platforms. Current CSIT-2110
  report data for Intel Xeon Ice Lake comes from an external source (Intel
  labs running CSIT code on “8360Y D Stepping” and “6338N” processors).

- MLRsearch improvements: Added support for multiple packet throughput rates
  in a single search, each rate is associated with a distinct Packet Loss Ratio
  (PLR) criterion. Previously only Non Drop Rate (NDR) (PLR=0) and single
  Partial Drop Rate (PDR) (PLR<0.5%) were supported. Implemented number of
  optimizations improving rate discovery efficiency.

- TREX performance tests: Added initial tests for testing latency between 2
  ports on nic on the TRex. Added tests: IP4Base, IP4scale2m, IP6Base,
  IP6scale2m, L2bscale1mmaclrn.

TEST FRAMEWORK

- CSIT test environment version has been updated to ver. 8: Intel NIC 700/800
  series firmware upgrade based on DPDK compatibility matrix.

- CSIT in AWS environment: Added CSIT support for AWS c5n instances
  environment.

Pointers to CSIT-2110 Report sections
-

1. FD.io CSIT test methodology  [1]
2. VPP release notes[2]
3. VPP 64B/IMIX throughput graphs   [3]
4. VPP throughput speedup multi-core[4]
5. VPP latency under load   [5]
6. VPP comparisons v21.10 vs. v21.06[6]
7. VPP performance all pkt sizes & NICs [7]
8. DPDK 21.08 apps release notes[8]
9. DPDK 64B throughput graphs   [9]
10. DPDK latency under load [10]
11. DPDK comparisons 21.08 vs. 21.02[11]
12. TRex 2.88 apps release notes[12]
13. TRex 64B throughput graphs  [13]
14. TRex latency under load [14]

Functional device tests (VPP_Device) are also included in the report.

[1] https://s3-docs.fd.io/csit/rls2110/report/introduction/methodology.html
[2] 
https://s3-docs.fd.io/csit/rls2110/report/vpp_performance_tests/csit_release_notes.html
[3] 
https://s3-docs.fd.io/csit/rls2110/report/vpp_performance_tests/packet_throughput_graphs/index.html
[4] 
https://s3-docs.fd.io/csit/rls2110/report/vpp_performance_tests/throughput_speedup_multi_core/index.html
[5] 
https://s3-docs.fd.io/csit/rls2110/report/vpp_performance_tests/packet_latency/index.html
[6] 
https://s3-docs.fd.io/csit/rls2110/report/vpp_performance_tests/comparisons/current_vs_previous_release.html
[7] 
https://s3-docs.fd.io/csit/rls2110/report/detailed_test_results/vpp_performance_results/index.html
[8] 
https://s3-docs.fd.io/csit/rls2110/report/dpdk_performance_tests/csit_release_notes.html
[9] 
https://s3-docs.fd.io/csit/rls2110/report/dpdk_performance_tests/packet_throughput_graphs/index.html
[10] 
https://s3-docs.fd.io/csit/rls2110/report/dpdk_performance_tests/packet_latency/index.html
[11] 
https://s3-docs.fd.io/csit/rls2110/report/dpdk_performance_tests/comparisons/current_vs_previous_release.html
[12] 
https://s3-docs.fd.io/csit/rls2110/report/trex_performance_tests/csit_release_notes.html
[13]

Re: [vpp-dev] [csit-dev] FD.io CSIT-2110 Release Report is published

2021-11-11 Thread Maciek Konstantynowicz (mkonstan) via lists.fd.io 
Hi Stanislav,

You are welcome.

Thanks for spotting, and you are right, the af_xdp driver numbers did a nose 
dive indeed.
It’s visible on xeon skylake per your link references, and also on:
- intel xeon cascadelake [2], [3],
- arm thunderx2 [4].

Comparison tables [5], [6] provide a proof that the drop is due to CSIT test 
environment change from v7 to v8 [7], and unlikely due to VPP code.
We need to investigate.

Hope this makes sense.

Cheers,
Maciek

[2] 
https://s3-docs.fd.io/csit/rls2110/report/vpp_performance_tests/packet_throughput_graphs/ip4-2n-clx-xxv710.html#b-2t1c-ip4routing-base-scale-af-xdp
[3] 
https://docs.fd.io/csit/rls2106/report/vpp_performance_tests/packet_throughput_graphs/ip4-2n-clx-xxv710.html#b-2t1c-ip4routing-base-scale-af-xdp
[4] 
https://s3-docs.fd.io/csit/rls2110/report/vpp_performance_tests/packet_throughput_graphs/ip4-2n-tx2-xl710.html#b-1t1c-ip4routing-base-scale-af-xdp
[5] search for “af-xdp” in 
https://s3-docs.fd.io/csit/rls2110/report/_static/vpp/performance-changes-2n-skx-2t1c-pdr.txt
[6] 
https://s3-docs.fd.io/csit/rls2110/report/vpp_performance_tests/comparisons/current_vs_previous_release.html
[7] 
https://s3-docs.fd.io/csit/rls2110/report/vpp_performance_tests/test_environment.html#environment-versioning

On 11 Nov 2021, at 14:47, Stanislav Zaikin 
mailto:zsta...@gmail.com>> wrote:

Thanks for the report!
Out of curiosity, what happened to AF_XDP? PPS rate was much bigger on r21.06.

[0] - 
https://s3-docs.fd.io/csit/rls2110/report/vpp_performance_tests/packet_throughput_graphs/ip4-2n-skx-x710.html
[1] - 
https://docs.fd.io/csit/rls2106/report/vpp_performance_tests/packet_throughput_graphs/ip4-2n-skx-x710.html

On Thu, 11 Nov 2021 at 15:19, Maciek Konstantynowicz (mkonstan) via 
lists.fd.io 
mailto:cisco@lists.fd.io>> wrote:
Big thanks to FD.io community contributors and supporters that 
enabled this data-rich publication.
Great job everyone!

Cheers,
Maciek

On 10 Nov 2021, at 18:12, Tibor Frank via lists.fd.io 
mailto:tifrank=cisco@lists.fd.io>> wrote:

Hi All,

FD.io CSIT-2110 report is now available on FD.io 
docs site:

https://s3-docs.fd.io/csit/rls2110/report/

Another successful release! Many thanks to all contributors in CSIT and
VPP communities for making it happen.

See below for CSIT-2110 release summary and pointers to specific
sections in the report.

Welcome all comments, best by email to 
csit-...@lists.fd.io.

Tibor


CSIT-2110 Release Summary
-

BENCHMARK TESTS

- Intel Xeon Ice Lake: Added test data for these platforms. Current CSIT-2110
  report data for Intel Xeon Ice Lake comes from an external source (Intel
  labs running CSIT code on “8360Y D Stepping” and “6338N” processors).

- MLRsearch improvements: Added support for multiple packet throughput rates
  in a single search, each rate is associated with a distinct Packet Loss Ratio
  (PLR) criterion. Previously only Non Drop Rate (NDR) (PLR=0) and single
  Partial Drop Rate (PDR) (PLR<0.5%) were supported. Implemented number of
  optimizations improving rate discovery efficiency.

- TREX performance tests: Added initial tests for testing latency between 2
  ports on nic on the TRex. Added tests: IP4Base, IP4scale2m, IP6Base,
  IP6scale2m, L2bscale1mmaclrn.

TEST FRAMEWORK

- CSIT test environment version has been updated to ver. 8: Intel NIC 700/800
  series firmware upgrade based on DPDK compatibility matrix.

- CSIT in AWS environment: Added CSIT support for AWS c5n instances
  environment.

Pointers to CSIT-2110 Report sections
-

1. FD.io CSIT test methodology  [1]
2. VPP release notes[2]
3. VPP 64B/IMIX throughput graphs   [3]
4. VPP throughput speedup multi-core[4]
5. VPP latency under load   [5]
6. VPP comparisons v21.10 vs. v21.06[6]
7. VPP performance all pkt sizes & NICs [7]
8. DPDK 21.08 apps release notes[8]
9. DPDK 64B throughput graphs   [9]
10. DPDK latency under load [10]
11. DPDK comparisons 21.08 vs. 21.02[11]
12. TRex 2.88 apps release notes[12]
13. TRex 64B throughput graphs  [13]
14. TRex latency under load [14]

Functional device tests (VPP_Device) are also included in the report.

[1] https://s3-docs.fd.io/csit/rls2110/report/introduction/methodology.html
[2] 
https://s3-docs.fd.io/csit/rls2110/report/vpp_performance_tests/csit_release_notes.html
[3] 
https://s3-docs.fd.io/csit/rls2110/report/vpp_performance_tests/packet_throughput_graphs/index.html
[4] 
https://s3-docs.fd.io/csit/rls2110/report/vpp_performance_tests/throughput_speedup_multi_core/index.html
[5] 
https://s3-docs.fd.io/csit/rls2110/report/vpp_performance_tests/packet_latency/index.html
[6] 
https://s3-docs.fd.io/csit/rls2110/report/vpp_performance_tests/comparisons/current_vs_previous_release.html

Re: [vpp-dev] [csit-dev] FD.io CSIT-2110 Release Report is published

2021-11-11 Thread Stanislav Zaikin 
Thanks for the report!
Out of curiosity, what happened to AF_XDP? PPS rate was much bigger on
r21.06.

[0] -
https://s3-docs.fd.io/csit/rls2110/report/vpp_performance_tests/packet_throughput_graphs/ip4-2n-skx-x710.html
[1] -
https://docs.fd.io/csit/rls2106/report/vpp_performance_tests/packet_throughput_graphs/ip4-2n-skx-x710.html

On Thu, 11 Nov 2021 at 15:19, Maciek Konstantynowicz (mkonstan) via
lists.fd.io  wrote:

> Big thanks to FD.io community contributors and supporters that enabled
> this data-rich publication.
> Great job everyone!
>
> Cheers,
> Maciek
>
> On 10 Nov 2021, at 18:12, Tibor Frank via lists.fd.io <
> tifrank=cisco@lists.fd.io> wrote:
>
> Hi All,
>
> FD.io  CSIT-2110 report is now available on FD.io
>  docs site:
>
> https://s3-docs.fd.io/csit/rls2110/report/
>
> Another successful release! Many thanks to all contributors in CSIT and
> VPP communities for making it happen.
>
> See below for CSIT-2110 release summary and pointers to specific
> sections in the report.
>
> Welcome all comments, best by email to csit-...@lists.fd.io.
>
> Tibor
>
>
> CSIT-2110 Release Summary
> -
>
> BENCHMARK TESTS
>
> - Intel Xeon Ice Lake: Added test data for these platforms. Current
> CSIT-2110
>   report data for Intel Xeon Ice Lake comes from an external source (Intel
>   labs running CSIT code on “8360Y D Stepping” and “6338N” processors).
>
> - MLRsearch improvements: Added support for multiple packet throughput
> rates
>   in a single search, each rate is associated with a distinct Packet Loss
> Ratio
>   (PLR) criterion. Previously only Non Drop Rate (NDR) (PLR=0) and single
>   Partial Drop Rate (PDR) (PLR<0.5%) were supported. Implemented number of
>   optimizations improving rate discovery efficiency.
>
> - TREX performance tests: Added initial tests for testing latency between 2
>   ports on nic on the TRex. Added tests: IP4Base, IP4scale2m, IP6Base,
>   IP6scale2m, L2bscale1mmaclrn.
>
> TEST FRAMEWORK
>
> - CSIT test environment version has been updated to ver. 8: Intel NIC
> 700/800
>   series firmware upgrade based on DPDK compatibility matrix.
>
> - CSIT in AWS environment: Added CSIT support for AWS c5n instances
>   environment.
>
> Pointers to CSIT-2110 Report sections
> -
>
> 1. FD.io  CSIT test methodology  [1]
> 2. VPP release notes[2]
> 3. VPP 64B/IMIX throughput graphs   [3]
> 4. VPP throughput speedup multi-core[4]
> 5. VPP latency under load   [5]
> 6. VPP comparisons v21.10 vs. v21.06[6]
> 7. VPP performance all pkt sizes & NICs [7]
> 8. DPDK 21.08 apps release notes[8]
> 9. DPDK 64B throughput graphs   [9]
> 10. DPDK latency under load [10]
> 11. DPDK comparisons 21.08 vs. 21.02[11]
> 12. TRex 2.88 apps release notes[12]
> 13. TRex 64B throughput graphs  [13]
> 14. TRex latency under load [14]
>
> Functional device tests (VPP_Device) are also included in the report.
>
> [1]
> https://s3-docs.fd.io/csit/rls2110/report/introduction/methodology.html
> [2]
> https://s3-docs.fd.io/csit/rls2110/report/vpp_performance_tests/csit_release_notes.html
> [3]
> https://s3-docs.fd.io/csit/rls2110/report/vpp_performance_tests/packet_throughput_graphs/index.html
> [4]
> https://s3-docs.fd.io/csit/rls2110/report/vpp_performance_tests/throughput_speedup_multi_core/index.html
> [5]
> https://s3-docs.fd.io/csit/rls2110/report/vpp_performance_tests/packet_latency/index.html
> [6]
> https://s3-docs.fd.io/csit/rls2110/report/vpp_performance_tests/comparisons/current_vs_previous_release.html
> [7]
> https://s3-docs.fd.io/csit/rls2110/report/detailed_test_results/vpp_performance_results/index.html
> [8]
> https://s3-docs.fd.io/csit/rls2110/report/dpdk_performance_tests/csit_release_notes.html
> [9]
> https://s3-docs.fd.io/csit/rls2110/report/dpdk_performance_tests/packet_throughput_graphs/index.html
> [10]
> https://s3-docs.fd.io/csit/rls2110/report/dpdk_performance_tests/packet_latency/index.html
> [11]
> https://s3-docs.fd.io/csit/rls2110/report/dpdk_performance_tests/comparisons/current_vs_previous_release.html
> [12]
> https://s3-docs.fd.io/csit/rls2110/report/trex_performance_tests/csit_release_notes.html
> [13]
> https://s3-docs.fd.io/csit/rls2110/report/trex_performance_tests/packet_throughput_graphs/index.html
> [14]
> https://s3-docs.fd.io/csit/rls2110/report/trex_performance_tests/packet_latency/index.html
>
>
>
>
>
> 
>
>

-- 
Best regards
Stanislav Zaikin

-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#20481): https://lists.fd.io/g/vpp-dev/message/20481
Mute This Topic: https://lists.fd.io/mt/86982560/21656
Group Owner: vpp-dev+ow...@lists.fd.io
Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub [arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-

Re: [vpp-dev] [csit-dev] FD.io CSIT-2110 Release Report is published

2021-11-11 Thread Ameen Al-Azzawi 
I would totally disagree.
It is disappointing when you base your research paper on VPP and the system
doesn't function.
I have asked here a million times about configuring ds-lite, no one helped.

On Thu, Nov 11, 2021 at 3:19 PM Maciek Konstantynowicz (mkonstan) via
lists.fd.io  wrote:

> Big thanks to FD.io community contributors and supporters that enabled
> this data-rich publication.
> Great job everyone!
>
> Cheers,
> Maciek
>
> On 10 Nov 2021, at 18:12, Tibor Frank via lists.fd.io <
> tifrank=cisco@lists.fd.io> wrote:
>
> Hi All,
>
> FD.io  CSIT-2110 report is now available on FD.io
>  docs site:
>
> https://s3-docs.fd.io/csit/rls2110/report/
>
> Another successful release! Many thanks to all contributors in CSIT and
> VPP communities for making it happen.
>
> See below for CSIT-2110 release summary and pointers to specific
> sections in the report.
>
> Welcome all comments, best by email to csit-...@lists.fd.io.
>
> Tibor
>
>
> CSIT-2110 Release Summary
> -
>
> BENCHMARK TESTS
>
> - Intel Xeon Ice Lake: Added test data for these platforms. Current
> CSIT-2110
>   report data for Intel Xeon Ice Lake comes from an external source (Intel
>   labs running CSIT code on “8360Y D Stepping” and “6338N” processors).
>
> - MLRsearch improvements: Added support for multiple packet throughput
> rates
>   in a single search, each rate is associated with a distinct Packet Loss
> Ratio
>   (PLR) criterion. Previously only Non Drop Rate (NDR) (PLR=0) and single
>   Partial Drop Rate (PDR) (PLR<0.5%) were supported. Implemented number of
>   optimizations improving rate discovery efficiency.
>
> - TREX performance tests: Added initial tests for testing latency between 2
>   ports on nic on the TRex. Added tests: IP4Base, IP4scale2m, IP6Base,
>   IP6scale2m, L2bscale1mmaclrn.
>
> TEST FRAMEWORK
>
> - CSIT test environment version has been updated to ver. 8: Intel NIC
> 700/800
>   series firmware upgrade based on DPDK compatibility matrix.
>
> - CSIT in AWS environment: Added CSIT support for AWS c5n instances
>   environment.
>
> Pointers to CSIT-2110 Report sections
> -
>
> 1. FD.io  CSIT test methodology  [1]
> 2. VPP release notes[2]
> 3. VPP 64B/IMIX throughput graphs   [3]
> 4. VPP throughput speedup multi-core[4]
> 5. VPP latency under load   [5]
> 6. VPP comparisons v21.10 vs. v21.06[6]
> 7. VPP performance all pkt sizes & NICs [7]
> 8. DPDK 21.08 apps release notes[8]
> 9. DPDK 64B throughput graphs   [9]
> 10. DPDK latency under load [10]
> 11. DPDK comparisons 21.08 vs. 21.02[11]
> 12. TRex 2.88 apps release notes[12]
> 13. TRex 64B throughput graphs  [13]
> 14. TRex latency under load [14]
>
> Functional device tests (VPP_Device) are also included in the report.
>
> [1]
> https://s3-docs.fd.io/csit/rls2110/report/introduction/methodology.html
> [2]
> https://s3-docs.fd.io/csit/rls2110/report/vpp_performance_tests/csit_release_notes.html
> [3]
> https://s3-docs.fd.io/csit/rls2110/report/vpp_performance_tests/packet_throughput_graphs/index.html
> [4]
> https://s3-docs.fd.io/csit/rls2110/report/vpp_performance_tests/throughput_speedup_multi_core/index.html
> [5]
> https://s3-docs.fd.io/csit/rls2110/report/vpp_performance_tests/packet_latency/index.html
> [6]
> https://s3-docs.fd.io/csit/rls2110/report/vpp_performance_tests/comparisons/current_vs_previous_release.html
> [7]
> https://s3-docs.fd.io/csit/rls2110/report/detailed_test_results/vpp_performance_results/index.html
> [8]
> https://s3-docs.fd.io/csit/rls2110/report/dpdk_performance_tests/csit_release_notes.html
> [9]
> https://s3-docs.fd.io/csit/rls2110/report/dpdk_performance_tests/packet_throughput_graphs/index.html
> [10]
> https://s3-docs.fd.io/csit/rls2110/report/dpdk_performance_tests/packet_latency/index.html
> [11]
> https://s3-docs.fd.io/csit/rls2110/report/dpdk_performance_tests/comparisons/current_vs_previous_release.html
> [12]
> https://s3-docs.fd.io/csit/rls2110/report/trex_performance_tests/csit_release_notes.html
> [13]
> https://s3-docs.fd.io/csit/rls2110/report/trex_performance_tests/packet_throughput_graphs/index.html
> [14]
> https://s3-docs.fd.io/csit/rls2110/report/trex_performance_tests/packet_latency/index.html
>
>
>
>
>
> 
>
>

-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#20480): https://lists.fd.io/g/vpp-dev/message/20480
Mute This Topic: https://lists.fd.io/mt/86982560/21656
Group Owner: vpp-dev+ow...@lists.fd.io
Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub [arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-

Re: [vpp-dev] [csit-dev] FD.io CSIT-2110 Release Report is published

2021-11-11 Thread Maciek Konstantynowicz (mkonstan) via lists.fd.io 
Big thanks to FD.io community contributors and supporters that 
enabled this data-rich publication.
Great job everyone!

Cheers,
Maciek

On 10 Nov 2021, at 18:12, Tibor Frank via lists.fd.io 
mailto:tifrank=cisco@lists.fd.io>> wrote:

Hi All,

FD.io CSIT-2110 report is now available on FD.io 
docs site:

https://s3-docs.fd.io/csit/rls2110/report/

Another successful release! Many thanks to all contributors in CSIT and
VPP communities for making it happen.

See below for CSIT-2110 release summary and pointers to specific
sections in the report.

Welcome all comments, best by email to 
csit-...@lists.fd.io.

Tibor


CSIT-2110 Release Summary
-

BENCHMARK TESTS

- Intel Xeon Ice Lake: Added test data for these platforms. Current CSIT-2110
  report data for Intel Xeon Ice Lake comes from an external source (Intel
  labs running CSIT code on “8360Y D Stepping” and “6338N” processors).

- MLRsearch improvements: Added support for multiple packet throughput rates
  in a single search, each rate is associated with a distinct Packet Loss Ratio
  (PLR) criterion. Previously only Non Drop Rate (NDR) (PLR=0) and single
  Partial Drop Rate (PDR) (PLR<0.5%) were supported. Implemented number of
  optimizations improving rate discovery efficiency.

- TREX performance tests: Added initial tests for testing latency between 2
  ports on nic on the TRex. Added tests: IP4Base, IP4scale2m, IP6Base,
  IP6scale2m, L2bscale1mmaclrn.

TEST FRAMEWORK

- CSIT test environment version has been updated to ver. 8: Intel NIC 700/800
  series firmware upgrade based on DPDK compatibility matrix.

- CSIT in AWS environment: Added CSIT support for AWS c5n instances
  environment.

Pointers to CSIT-2110 Report sections
-

1. FD.io CSIT test methodology  [1]
2. VPP release notes[2]
3. VPP 64B/IMIX throughput graphs   [3]
4. VPP throughput speedup multi-core[4]
5. VPP latency under load   [5]
6. VPP comparisons v21.10 vs. v21.06[6]
7. VPP performance all pkt sizes & NICs [7]
8. DPDK 21.08 apps release notes[8]
9. DPDK 64B throughput graphs   [9]
10. DPDK latency under load [10]
11. DPDK comparisons 21.08 vs. 21.02[11]
12. TRex 2.88 apps release notes[12]
13. TRex 64B throughput graphs  [13]
14. TRex latency under load [14]

Functional device tests (VPP_Device) are also included in the report.

[1] https://s3-docs.fd.io/csit/rls2110/report/introduction/methodology.html
[2] 
https://s3-docs.fd.io/csit/rls2110/report/vpp_performance_tests/csit_release_notes.html
[3] 
https://s3-docs.fd.io/csit/rls2110/report/vpp_performance_tests/packet_throughput_graphs/index.html
[4] 
https://s3-docs.fd.io/csit/rls2110/report/vpp_performance_tests/throughput_speedup_multi_core/index.html
[5] 
https://s3-docs.fd.io/csit/rls2110/report/vpp_performance_tests/packet_latency/index.html
[6] 
https://s3-docs.fd.io/csit/rls2110/report/vpp_performance_tests/comparisons/current_vs_previous_release.html
[7] 
https://s3-docs.fd.io/csit/rls2110/report/detailed_test_results/vpp_performance_results/index.html
[8] 
https://s3-docs.fd.io/csit/rls2110/report/dpdk_performance_tests/csit_release_notes.html
[9] 
https://s3-docs.fd.io/csit/rls2110/report/dpdk_performance_tests/packet_throughput_graphs/index.html
[10] 
https://s3-docs.fd.io/csit/rls2110/report/dpdk_performance_tests/packet_latency/index.html
[11] 
https://s3-docs.fd.io/csit/rls2110/report/dpdk_performance_tests/comparisons/current_vs_previous_release.html
[12] 
https://s3-docs.fd.io/csit/rls2110/report/trex_performance_tests/csit_release_notes.html
[13] 
https://s3-docs.fd.io/csit/rls2110/report/trex_performance_tests/packet_throughput_graphs/index.html
[14] 
https://s3-docs.fd.io/csit/rls2110/report/trex_performance_tests/packet_latency/index.html






-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#20479): https://lists.fd.io/g/vpp-dev/message/20479
Mute This Topic: https://lists.fd.io/mt/86982560/21656
Group Owner: vpp-dev+ow...@lists.fd.io
Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub [arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-