Re: [vpp-dev] continuous decline in throughput with acl

I test latest master, throughput slowdown is fixed, Although I see growing memory usage. I will post a new thread and describe how to reproduce the situation. Regards On Tue, Sep 25, 2018 at 3:14 PM emma sdi wrote: > Excellent, I'm going out of office. I will rerun my test with latest >

Re: [vpp-dev] continuous decline in throughput with acl

Hmm this output does look exactly like what I had before commit ed435504 - the IPv6 table bucket area gets corrupted by the overruns from IPv4 table arena. And then I spotted the leak which was happening during the rehash which I fixed in 11521387. Your (very few) freelists look like you don’t

Re: [vpp-dev] continuous decline in throughput with acl

I checked out from gerrrit, I think it's using latest master. ( but i make another version to make sure ) let me explain how I produce this situation, while true :) 1- run trex ./t-rex-64 --cfg cfg/trex_config.yaml -f cap2/sfr.yaml -m 7 -c 2 2-stop trex after ~120 seconds 3- wait until all

Re: [vpp-dev] continuous decline in throughput with acl

Are you using latest master ? I fixed a couple of issues in bihash last week related to memory usage... if it’s the latest master, the output of used vs available looks weird... - so please let me know... As for the “general” growth - basically what happens is bihash doubles each bucket size

Re: [vpp-dev] continuous decline in throughput with acl

It's amazing!!! IPv4 Session lookup hash table: Hash table ACL plugin FA IPv4 session bihash 968086 active elements 65536 active buckets 13 free lists [len 16] 1 free elts [len 32] 1 free elts [len 256] 10669 free elts [len 512] 36768 free elts [len

Re: [vpp-dev] continuous decline in throughput with acl

Yes, that's right. I think is completely another issue from the patch you sent On Tue, Sep 25, 2018 at 1:35 PM Andrew  Yourtchenko wrote: > Excellent, thanks! > > Memory usage - you mean in bihash arena ? > > --a > > On 25 Sep 2018, at 11:38, khers wrote: > > Throughput and session add/del is

Re: [vpp-dev] continuous decline in throughput with acl

Excellent, thanks! Memory usage - you mean in bihash arena ? --a > On 25 Sep 2018, at 11:38, khers wrote: > > Throughput and session add/del is stable as rock. The only danger i see is > growing memory usage. > look at this > > >> On Tue, Sep 25, 2018 at 11:31 AM khers wrote: >> Of

Re: [vpp-dev] continuous decline in throughput with acl

Throughput and session add/del is stable as rock. The only danger i see is growing memory usage. look at this On Tue, Sep 25, 2018 at 11:31 AM khers wrote: > Of course, I test your patch, there is no slowdown with my scenario. I > need more time to test

Re: [vpp-dev] continuous decline in throughput with acl

Of course, I test your patch, there is no slowdown with my scenario. I need more time to test other scenarios and make sure. On Mon, Sep 24, 2018 at 3:11 PM Andrew  Yourtchenko wrote: > Cool. Then it is probably indeed the session requeues that are not yet > efficient... I have been looking

Re: [vpp-dev] continuous decline in throughput with acl

Cool. Then it is probably indeed the session requeues that are not yet efficient... I have been looking at optimizing that. I have a draft in the works which should have less session requeues - I have just added you to it, could you give it a shot and see if it makes things better ? --a >

Re: [vpp-dev] continuous decline in throughput with acl

yes, I confirm On Mon, Sep 24, 2018 at 2:08 PM Andrew  Yourtchenko wrote: > Okay, so what I think I am hearing - the gradual slowdown is/was always > there, and is somewhat more pronounced in master, right ? > > --a > > On 24 Sep 2018, at 11:49, khers wrote: > > I allways get SIGSEGV or

Re: [vpp-dev] continuous decline in throughput with acl

Okay, so what I think I am hearing - the gradual slowdown is/was always there, and is somewhat more pronounced in master, right ? --a > On 24 Sep 2018, at 11:49, khers wrote: > > I allways get SIGSEGV or 'worker thread dead lock' In 1804 with 1 or more > worker thread and 1 main, > but when

Re: [vpp-dev] continuous decline in throughput with acl

I allways get SIGSEGV or 'worker thread dead lock' In 1804 with 1 or more worker thread and 1 main, but when vpp using one cpu I hadn't any problem. In the 1807 multi core is stable i didn't see any of those problem but throughput is declining slowly. I ran another test with same version of last

Re: [vpp-dev] continuous decline in throughput with acl

Interesting - but you are saying in 1804 this effect is not observed ? There was no other notable changes with regards to session management - but maybe worth it to just do hit bisect and see. Should be 4-5 iterations. Could you verify that - if indeed this is not seen in 1804. --a > On 23

Re: [vpp-dev] continuous decline in throughput with acl

I checked out the version before the gerrit 12770 is merged to master. 2371c25fed6b2e751163df590bb9d9a93a75a0f I got SIGSEGV with 2 workers, so I repeat the test with one worker. Throughput is going down like the latest version. On Sun, Sep 23, 2018 at 4:55 PM Andrew  Yourtchenko wrote: >

Re: [vpp-dev] continuous decline in throughput with acl

Would you be able to confirm that it changes at a point of https://gerrit.fd.io/r/#/c/12770/ ? --a > On 23 Sep 2018, at 13:31, emma sdi wrote: > > Dear Community > > I have simple configuration as following: > > startup.conf > simple_acl > > I used Trex packet generator with following