Re: [vpp-dev] How to trigger perf test and compare the results

Hi Zhiyong, We’re in the process of adding gerrit triggers to provide more complete coverage of MRR tests per vpp patch. What (NIC,featureset) combination(s) are you after? -Maciek On 31 May 2018, at 10:55, Damjan Marion mailto:dmarion.li...@gmail.com>> wrote: Dear Zhiyong, csit-dev is

Re: [vpp-dev] [csit-dev] Draft proposal to introduce a new set of integration tests

ting. . Atom: TBC. * Project: FD.io<http://FD.io> CSIT. . Plan: progress in rls1807. On 6 Jun 2018, at 14:25, Maciek Konstantynowicz (mkonstan) via Lists.Fd.Io mailto:mkonstan=cisco@lists.fd.io>> wrote: Thanks for all comments! Here is an up

Re: [csit-dev] [vpp-dev] VPP make test gives false positive

Any updates on the latest status? -Maciek > On 22 Jun 2018, at 18:07, Ole Troan wrote: > >> 13188 is already merged. > > 13186 fails consistently locally too, investigating. > I think this was introduced with a98346f664aae148d26a8e158008b773d73db96f > > Cheers, > Ole > > >> >> From:

[vpp-dev] CSIT_VPP_trending_failures: DPDK link bonding

Summary: https://docs.fd.io/csit/master/trending/introduction/failures.html CSIT_VPP_trending_failures: DPDK link bonding Failed_tests_count: 14 Failed_tests_list:

[vpp-dev] CSIT_VPP_trending_regressions: 1t1c summary

Summary: https://docs.fd.io/csit/master/trending/introduction/index.html#vpp-worker-on-1t1c Regression_tests_count: 15 Regression_tests_list:

[vpp-dev] CSIT_VPP_trending_failures: ip4scale, ip6scale

Summary: https://docs.fd.io/csit/master/trending/introduction/failures.html CSIT_VPP_trending_failures: DPDK link bonding Failed_tests_count: 18 Failed_tests_list:

[vpp-dev] CSIT_VPP_trending_failures: IPSec

Summary: https://docs.fd.io/csit/master/trending/introduction/failures.html CSIT_VPP_trending_failures: DPDK link bonding Failed_tests_count: 10 Failed_tests_list:

[vpp-dev] CSIT VIRL P0 migration to make test completed

Just wanted to confirm that the last patches for ecmp ip4 and ip6 tests got merged [1]. With this VIRL P0 [2] test migration to VPP make test is completed. Ed, per discussion on last Tue vpp-dev call, you may want to disable vpp-csit-verify-virl-master [3] voting on VPP patches. -Maciek [1]

Re: [vpp-dev] Parallel test execution in VPP Test Framework

Alec, This is about make test and not real packet forwarding. Per Juraj’s patch [1] Juraj, My understanding is that if you’re starting VPP without specifying core placement in startup.conf [2] cpu {..}, then Linux CFS will be placing the threads onto available cpu core resources. If you’re

Re: [csit-dev] [vpp-dev] Parallel test execution in VPP Test Framework

of them is answering why is this happening. Peter Mikus Engineer – Software Cisco Systems Limited From: csit-...@lists.fd.io<mailto:csit-...@lists.fd.io> [mailto:csit-...@lists.fd.io] On Behalf Of Maciek Konstantynowicz (mkonstan) via Lists.Fd.Io Sent: Friday, July 27, 2018 6:53 PM To: Al

[vpp-dev] FD.io CSIT-18.07 v1.0 report published

Hi All, FD.io CSIT-18.07 report has been published on FD.io docs site: html: https://docs.fd.io/csit/rls1807/report/ pdf: https://docs.fd.io/csit/rls1807/report/_static/archive/csit_rls1807.pdf Many thanks to All in CSIT and FD.io community who contributed and made CSIT-18.07 happen!

Re: [vpp-dev] Parallel test execution in VPP Test Framework

On 19 Jul 2018, at 15:44, Juraj Linkeš mailto:juraj.lin...@pantheon.tech>> wrote: Hi VPP devs, I'm implementing parallel test execution of tests in VPP Test Framework (the patch is here https://gerrit.fd.io/r/#/c/13491/) and the last big outstanding question is how scalable the

[vpp-dev] VPP l2 path regressions in trending

Full set of detected regressions is listed in VPP Performance Dashboard [1]. Subset of tests reporting packet throughput regressions ~10%: 1. v18.11-rc0-13 to rc0-19 a. some tests with 64B throughput drop: - -10% - 10ge2p1x710-64b-1t1c-eth-l2xcbase-eth-2memif-1lxc-mrr - -8% -

[vpp-dev] FD.io CSIT Project weekly meeting - UTC GMT time change, UK and EU no change

Hi, Just wanted to make everyone aware that today’s call is taking place at 15:00-16:00 UTC, as UK and Europe moved away from Daylight Saving Time (BST, CEST respectively), and looking thru the window Summer time is definitely over, so time to change our regular habits :) Updated details are in

[vpp-dev] FD.io compute infra down -

Nexus(?) backend to nginx is reporting down. Resolution time? Cheers, -Maciek [cid:876751CF-C733-46B9-9A07-8298C0A0A0C8@cisco.com] -=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#11286): https://lists.fd.io/g/vpp-dev/message/11286 Mute This Topic:

[vpp-dev] FD.io talks at ONS EU in AMS last week

FYI, here are the Compressed PDF copies of slides presented at EU Open Network Summit in Amsterday. Some material has been out there but got adopted. Some is nett new, produced by speakers/authors. On-site response was good, let’s see what the survey says.. if we ever see the results. If we’re

Re: [vpp-dev] VAT api changes 5507192..8807674

Is it still broken? -Maciek On 3 Oct 2018, at 09:11, Peter Mikus via Lists.Fd.Io mailto:pmikus=cisco@lists.fd.io>> wrote: Hello devs, Recently in CSIT we are facing the issue with vpp_api_test console with JSON enabled, when calling dump_interface_table: dump_interface_table:6017: JSON

[vpp-dev] FD.io CSIT-18.10.w47 Weekly Maintenance Report Update

FD.io CSIT-18.10.w47 weekly maintenance report has been published on FD.io docs site: html: https://docs.fd.io/csit/rls1810/report/ pdf: https://docs.fd.io/csit/rls1810/report/_static/archive/csit_rls1810.pdf Changes from last week .w46 version: 1. Added automated wrapping of long test names

Re: [csit-dev] [vpp-dev] Heads up: API cleanup

// re-adding vpp-dev, Neale, Ole Vratko, thanks for spotting! Spoke with Neale, he confirmed route add/del API changes should be transparent to VAT per his updates in [1]. If you spotted any VatExecutor breakage, then this would need to be fixed before [2] is merged. And as CSIT embarked on VAT

[vpp-dev] Published: Tech paper - "Benchmarking SW Data Planes Intel Xeon Skylake vs. Broadwell"

Hi, We finally managed to get the go ahead to publish above technical paper. Workloads tested: VPP, OVS-DPDK, DPDK(testpmd,l3fwd), CoreMark. Processors tested: Intel Xeon Skylake vs. Broadwell. Compared side-by-side: performance and efficiency of workloads/processors. Thanks to all

[vpp-dev] Published: FD.io CSIT-1901 Open-Source Benchmarking Report

Hi All, FD.io CSIT-1901 report has been published on FD.io docs site: html: https://docs.fd.io/csit/rls1901/report/ pdf: https://docs.fd.io/csit/rls1901/report/_static/archive/csit_rls1810.pdf Many thanks to All in CSIT, VPP and FD.io community who contributed, worked very hard to make

[vpp-dev] Published: FD.io CSIT-1904 Benchmarking Report

Hi All, FD.io CSIT-1904 report has been published on FD.io docs site: html: https://docs.fd.io/csit/rls1904/report/ pdf: https://docs.fd.io/csit/rls1904/report/_static/archive/csit_rls1904.pdf Many thanks to All in CSIT, VPP and FD.io community who contributed and worked hard to make CSIT-1904

Re: [vpp-dev] VPP 19.04 Release is complete!

Great work All! On 24 Apr 2019, at 23:06, Dave Wallace mailto:dwallac...@gmail.com>> wrote: Folks, I am pleased to announce that the VPP 19.04 Release is complete and the release artifacts are available on PackageCloud: https://packagecloud.io/fdio/release Many thanks to all of the VPP &

Re: [vpp-dev] VPP 19.08 release is available!

Congrats to All involved in vpp-dev and FD.io on timely and feature-rich VPP v19.08 release! Andrew, congrats on 19.08 and best of luck for the next 10 yrs! ;) Cheers, -Maciek On 21 Aug 2019, at 22:19, Damjan Marion via Lists.Fd.Io mailto:dmarion=me@lists.fd.io>> wrote:

Re: [vpp-dev] [csit-dev] FD.io Jenkins Maintenance: 2019-08-29 @ 1700 UTC and 2019-08-30 @ 1700 UTC

Thank you Vanessa for this good news! We are aiming to complete the critical part of the CSIT-1908 testing jobs by 04-Sep, will keep you and the team posted. Cheers, -Maciek On 29 Aug 2019, at 18:18, Vanessa Valderrama mailto:vvalderr...@linuxfoundation.org>> wrote: Sandbox upgrade is

[vpp-dev] CSIT-1908 draft report preview available, need help with two VPP performance regressions

Hi, A draft version of CSIT-1908 test and benchmarking report is available on the CSIT master report link: https://docs.fd.io/csit/master/report/index.html Most of the selected benchmarking tests have been completed including: - All Xeon Skylake and Haswell NDR and PDR tests - all in draft

[vpp-dev] Published: FD.io CSIT-1908 Release Report

Hi All, FD.io CSIT-1908 report has been published on FD.io docs site: html: https://docs.fd.io/csit/rls1908/report/ pdf: https://docs.fd.io/csit/rls1908/report/_static/archive/csit_rls1908.pdf Many thanks to All in CSIT, VPP and wider FD.io community who contributed and worked hard to make

Re: [vpp-dev] [tsc] FD.io Production Jenkins Restart Required

Hi Vanessa, Thanks for the note. CSIT project keeps experiencing issues due to Jenkins outages. Do you have ETA for the fix that will stop these outages? -Maciek > On 5 Nov 2019, at 23:18, Vanessa Valderrama > wrote: > > Jenkins has been restarted, job views restored, jobs are running. > >

Re: [vpp-dev] Gerrit 25463 fails API CRC check for no obvious reason...

Hi Dave, thanks for notifying, we have just discussed this on the CSIT project call, Vratko is looking into this. Here are the incompatible API CRCs that are tripping the job. Will notify on this thread once issue is nailed down. Cheers, -Maciek 13:24:04 Incompatible API CRCs found in

[vpp-dev] Published: FD.io CSIT-2001 Release Report - CSIT-2001.09 update

Update: CSIT-2001.09 maintenance report has been published: https://docs.fd.io/csit/rls2001/report/ Changes from last week version include: Added VPP performance test data into Detailed Results per testbed types: - 2n-clx (Xeon Cascadelake): IPv4, IPv6, L2. - 2n-dnv (Atom

[vpp-dev] Published: FD.io CSIT-2001 Release Report

Hi All, FD.io CSIT-2001 report has been published on FD.io docs site: https://docs.fd.io/csit/rls2001/report/ Many thanks to All in CSIT, VPP and wider FD.io community who contributed and worked hard to make CSIT-2001 happen! Below three summaries: - Intel Xeon 2n-skx, 3n-skx and 2n-clx

Re: [vpp-dev] [csit-dev] FDIO Maintenance - 2020-02-05 1900 UTC to 2400 UTC

Hi Vanessa, Many thanks for the heads-up. Unfortunately 05-Feb hits is in the middle of CSIT-2001 release, per published schedule here: https://wiki.fd.io/view/CSIT/csit2001_plan Is there any chance to postpone this upgrade till after 19-Feb, which is +1 week after our report publish target

[vpp-dev] CSIT-2001 update: Xeon Skylake Performance and Progressions/Regressions RCAs

Dear All, We have finally pushed out an update to CSIT-2001 report with VPP performance data for testbeds with Intel Xeon Skylake processors (2n-skx and 3n-skx testbeds), with SUT and TG servers impacted by firmware and OS upgrades (BIOS, ucode, kernel updates with mitigations against the newly

Re: [vpp-dev] CSIT-2001 update: Xeon Skylake Performance and Progressions/Regressions RCAs

Slides used on today’s VPP call: https://wiki.fd.io/view/File:200512-csit-vpp-readout.pptx > On 12 May 2020, at 15:18, Maciek Konstantynowicz (mkonstan) > wrote: > > Dear All, > > We have finally pushed out an update to CSIT-2001 report with VPP > performance data for testbeds with Intel

Re: [vpp-committers] [vpp-dev] VPP committers: VPP PTL vote

+csit-dev Congrats Damjan - well done! And Dave, huge Thank You, once again, for starting and navigating the FD.io VPP project with skill, strength and wit, and for making FD.io what it is today, with a healthily growing FD.io community and code base across a diverse group of members and

[vpp-dev] Published: FD.io CSIT-2005 Release Report

Hi All, FD.io CSIT-2005 report has been published on FD.io docs site: https://docs.fd.io/csit/rls2005/report/ Many thanks to All in CSIT, VPP and wider FD.io community who contributed and worked hard to make CSIT-2005 happen! See below for pointers to specific sections in the report.

[vpp-dev] LFN DCs network outage - CSIT test jobs stopped until further notice

Dear All, Due to ongoing network issues in LFN hosted Data Centres CSIT project is stopping all automated benchmarking tests until further notice. All daily and weekly trending, as well as CSIT-2005 report test jobs are stopped. LFN IT and Vexxhost teams are engaged. For latest see these two

[vpp-dev] AMD and NAT44ed stateful benchmarks in updated CSIT-2009 Report

Hi All, Quick update re recent major additions to CSIT-2009 report available at https://docs.fd.io/csit/rls2009/report/ : 1. Benchmark results for AMD 2n-zn2 testbed (EPYC Zen2 7532) with VPP and DPDK performance data: - Testbed description in [12] - Sample throughput graphs in [13]

[vpp-dev] VPP: A Terabit Secure Network Data-plane

https://www.youtube.com/watch?v=ipQQmjzE_g0 -=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#19124): https://lists.fd.io/g/vpp-dev/message/19124 Mute This Topic: https://lists.fd.io/mt/81916291/21656 Group Owner: vpp-dev+ow...@lists.fd.io

Re: [vpp-dev] VPP: A Terabit Secure Network Data-plane

> Thanks for sharing. > > Did you test on ARM to see what the performance is? > > Hemant > > -Original Message- > From: vpp-dev@lists.fd.io On Behalf Of Maciek > Konstantynowicz (mkonstan) via lists.fd.io > Sent: Wednesday, April 07, 2021 10:02 AM > To: cs

[vpp-dev] FD.io CSIT-2101 Release Report is published

Hi All, FD.io CSIT-2101 report is available on FD.io docs site: https://docs.fd.io/csit/rls2101/report/ Many thanks to all contributors in CSIT and VPP communities! See below for CSIT-2101 release summary and pointers to specific sections in the report. Welcome all comments, best by email

[vpp-dev] FD.io CSIT-2106 Release Report is published

Hi All, FD.io CSIT-2106 report is now available on FD.io docs site: https://docs.fd.io/csit/rls2106/report/ Another successful release! Many thanks to all contributors in CSIT and VPP communities for making it happen. See below for CSIT-2106 release summary and pointers to specific sections

Re: [vpp-dev] FD.io CSIT-2106 Release Report is published

Caveat note :) Number of the latency graphs in report show excessive numbers O(sec) across frame sizes w/o and with load for both VPP and DPDK. Few of us in CSIT are working on the resolution, stay tuned. For now please ignore those numbers. Cheers, Maciek > On 15 Jul 2021, at 13:03, Maciek

Re: [vpp-dev] [csit-dev] FD.io CSIT-2110 Release Report is published

report/vpp_performance_tests/packet_throughput_graphs/ip4-2n-skx-x710.html [1] - https://docs.fd.io/csit/rls2106/report/vpp_performance_tests/packet_throughput_graphs/ip4-2n-skx-x710.html On Thu, 11 Nov 2021 at 15:19, Maciek Konstantynowicz (mkonstan) via lists.fd.io<http://lists.fd.io/>

Re: [vpp-dev] [csit-dev] FD.io CSIT-2110 Release Report is published

Big thanks to FD.io community contributors and supporters that enabled this data-rich publication. Great job everyone! Cheers, Maciek On 10 Nov 2021, at 18:12, Tibor Frank via lists.fd.io mailto:tifrank=cisco@lists.fd.io>> wrote: Hi All,

Re: [vpp-dev] [csit-dev] FD.io CSIT-2110 Release Report is published

paper on VPP and the system doesn't function. I have asked here a million times about configuring ds-lite, no one helped. On Thu, Nov 11, 2021 at 3:19 PM Maciek Konstantynowicz (mkonstan) via lists.fd.io<http://lists.fd.io/> mailto:cisco@lists.fd.io>> wrote: Big thanks to FD.

Re: [vpp-dev] [csit-dev] FD.io CSIT-2110 Release Report is published

doesn't function. I have asked here a million times about configuring ds-lite, no one helped. On Thu, Nov 11, 2021 at 3:19 PM Maciek Konstantynowicz (mkonstan) via lists.fd.io<http://lists.fd.io/> mailto:cisco@lists.fd.io>> wrote: Big thanks to FD.io<http://fd.io/> com

Re: [vpp-dev] [csit-dev] Thu 13-Jan FD.io CSIT talk at LFN Developer & Testing Forum

Zoom link to the session per teamup link below: https://zoom.us/j/96267999834?pwd=UnBNM2NveXgyT3BpdkNSenV2VjJjQT09 We will post the materials on the event wiki link listed below and in fd.io wiki, will send links. > On 11 Jan 2022, at 15:58, Maciek Konstantynowicz (mkonstan) via lists.fd

[vpp-dev] Thu 13-Jan FD.io CSIT talk at LFN Developer & Testing Forum

Dear All, Some of us from CSIT will be giving a talk at this week LFN Developer & Testing Forum (virtual event via Zoom, and it’s free to attend). Title: FD.io CSIT Performance Benchmarking, Anomaly Detection, Results Tracking. Time: Thursday 13th January 2021 13:00-14:00 GMT (London)

[vpp-dev] topic proposal for today's vpp community call

Hi, If possible, in today’s meeting, we would like to cover highlights of vpp performance regressions and test failures based on v22.02 rc2 testing in CSIT. 5-10 min will suffice to cover the highlights. Vratko will be sending current summary in email to vpp-dev and csit-dev before the

Re: [vpp-dev] Thu 13-Jan FD.io CSIT talk at LFN Developer & Testing Forum

Here pointers to materials and recordings from the session last week - Enjoy: CSIT Talk: Performance Benchmarking, Anomaly Detection, Results Tracking

[vpp-dev] CSIT topics for VPP meeting today

Hi, We would like to spend 5-10min doing the CSIT-2202 vpp rls notes review, specifically recorder failures and regressions. Vratko and me will lead that. If there is no time on the call agenda today, no sweat, we can do it on the next call. Cheers, Maciek -=-=-=-=-=-=-=-=-=-=-=- Links: You

[vpp-dev] New CSIT dashboard with VPP and DPDK performance data

Hi, Following from Tibor's demo of the new CSIT dashboard on the VPP call last Tuesday, here the links to what was presented. Note that the backend and frontend apps are still being tuned, so please treat this as an engineering preview. Glitches and disruption are likely to occur :) - Current

Re: [vpp-dev] [tsc-private] [csit-dev] TRex - replacing CVL with MLX for 100GbE

so it’s refreshed in our collective memory, as discussed on TSC call just now. Number of 2p100GE MLX NICs needed for performance testing of Ampere Altra servers are listed under point 4 below. Let me know if anything unclear and/or if any questions. Cheers, Maciek On 28 Jan 2022, at 17:3

[vpp-dev] CSIT and VPP 22.02 known issues status check

Hi, We have been discussing and working through a number of known issues since VPP v22.02 and CSIT-2202 shipped. Entering v22.06 rc2, so I thought it’s good time to take an overall read of status, as jira is not always an accurate reflection. Below my compilation based on CSIT-2202 report and

[vpp-dev] VPP call topic - csit.fd.io perf dashboard preview

Hi Damjan, For the VPP call today, if possible, could we get 10-15min for CSIT team to do a demo of the new csit.fd.io perf dashboard? Cheers, Maciek -=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#21439):

[vpp-dev] Bumping dpdk to 22.11 in vpp 23.02 ?

Hi, On CSIT call just now Kai made us aware of issues with above (cryptodev, sat), as captured in this patch: 37840: dpdk: make impact to VPP for changes in API for DPDK 22.11 | https://gerrit.fd.io/r/c/vpp/+/37840 23.02 RC1 is next week and in CSIT we start testing at RC1 milestone, so