This seems to be isolating the issue a bit more, which at this point I believe has to be in the upper stack. The driver has no control on where a given packet comes in on a Tx queue, the stack makes that choice. I have no idea why the stack would collapse all flows to one queue when are transmitting a SYN storm.
As for why this would be effected by turning off ATR (AtrSampleRate=0) I can only speculate. ATR only deals with queue selection on ingress packets and as you mentioned no traffic is being generated in response to these SYN packets so there shouldn't be any ingress traffic. Likewise the stack above us has no idea we are doing ATR other than igress packets (which there are none in the SYN only case) will arrive spread over multiple queues. We do try to create a hash bucket for each egress SYN packet. And since our HW table is limited we would have to flush it quite often with all these SYN's, but once again this should be transparent to the upper stack other than "maybe" a slight performance hit. In the end it really comes down to we don't pick the egress queues a packet come in on they are given us that way be the stack. Thanks, -Don Skidmore <donald.c.skidm...@intel.com> > -----Original Message----- > From: Viktor Khomyuk [mailto:v.khom...@office.ngs.ru] > Sent: Friday, December 19, 2014 6:20 AM > To: Skidmore, Donald C; Fujinaka, Todd; Tantilov, Emil S; e1000- > de...@lists.sourceforge.net > Subject: Re: [E1000-devel] ixgbe use only one queue for outgoing vlan when > AtrSampleRate=0 > > Yes! Traffic generator is just producing SYN egress packets. > > eth2 > RX packets:1 errors:0 dropped:0 overruns:0 frame:0 > TX packets:112598 errors:0 dropped:0 overruns:0 carrier:0 > eth2.4001 > RX packets:1 errors:0 dropped:0 overruns:0 frame:0 > TX packets:317838 errors:0 dropped:0 overruns:0 carrier:0 I use > hping3 > with --rand-source so no traffic return to me. TCP, UDP or ICMP, random src > or dst port has same issue. > > With "normal" traffic all queues are used! > With mix (normal traffic and syn flood) I see one queue is overloaded. > > 19.12.2014 4:42, Skidmore, Donald C пишет: > > Hey Viktor, > > > > I like your idea of focusing on simplicity, helps keeps the issue we > > are talking about clear. :) > > > > To further this trend, can you verify your traffic generator is just > > producing > SYN egress packets? If so have you seen the same issue using more > "normal" traffic (i.e. several instants of netperf running in parallel)? > > > > If my assumption (your generator is only producing SYN egress packets) > above is correct this is an interesting issue. Since the driver doesn't have > anything to do with our egress queue selection, netdev sends us what it will > on whatever queue it chooses. However you seem to be able to effect this > choice by turning off ATR while using Vlan's? This is why I would like to > know > if you see this behavior without using the traffic generator. > > > > Thanks, > > -Don > > > >> -----Original Message----- > >> From: Viktor Khomyuk [mailto:v.khom...@office.ngs.ru] > >> Sent: Wednesday, December 17, 2014 11:23 PM > >> To: Fujinaka, Todd; Skidmore, Donald C; Tantilov, Emil S; e1000- > >> de...@lists.sourceforge.net > >> Subject: Re: [E1000-devel] ixgbe use only one queue for outgoing vlan > >> when > >> AtrSampleRate=0 > >> > >> For simplicity's sake we can talk only about traffic generator. > >> When AtrSampleRate=1 and no vlan interface exists - all queues are used. > >> When AtrSampleRate=1 and vlan interface is used for outgoing - all > >> queues are used. > >> When AtrSampleRate=0 and no vlan interface exists - all queues are used. > >> > >> When AtrSampleRate=0 and vlan interface is used for outgoing - only > >> one queue is used. > >> > >> 17.12.2014 0:35, Fujinaka, Todd пишет: > >>> Perhaps a network diagram would help. It sounds like you're the > >>> router, > >> with multiple flows coming in and one going out. If this is the case, > >> the rx/tx would be paired and all on one queue. > >>> Can you please clarify? > >>> > >>> Todd Fujinaka > >>> Software Application Engineer > >>> Networking Division (ND) > >>> Intel Corporation > >>> todd.fujin...@intel.com > >>> (503) 712-4565 > >>> > >>> -----Original Message----- > >>> From: Viktor Khomyuk [mailto:v.khom...@office.ngs.ru] > >>> Sent: Monday, December 15, 2014 7:49 PM > >>> To: Skidmore, Donald C; Tantilov, Emil S; > >>> e1000-devel@lists.sourceforge.net > >>> Subject: Re: [E1000-devel] ixgbe use only one queue for outgoing > >>> vlan when AtrSampleRate=0 > >>> > >>> > >>> 16.12.2014 6:48, Skidmore, Donald C пишет: > >>>> I would expect this to work. > >>>> > >>>> To be clear you are: > >>>> - creating a vlan > >>>> - turning off flow director > >>>> - receiving traffic from multiple IP address > >>>> - but seeing all the traffic all go to just the first queue. > >>> - creating a vlan > >>> - turning off flow director > >>> - turning off irqbalance > >>> - set_irq_affinity > >>> - sending(or generating) traffic from multiple IP address > >>> - but seeing all the traffic all go to just the one (not always first) > >>> queue. > >>> > >>> On traffic generator all traffic go to just the one queue. > >>> On router incoming traffic distribute over multiple queues, but > >>> outgoing > >> traffic go to only one. > >>>> You don't by any change have set up and ntuple rules have you? > >>>> > >>>> Thanks, > >>>> -Don Skidmore <donald.c.skidm...@intel.com> > >>>> > >>>>> -----Original Message----- > >>>>> From: Viktor Khomyuk [mailto:v.khom...@office.ngs.ru] > >>>>> Sent: Sunday, December 14, 2014 8:14 PM > >>>>> To: Tantilov, Emil S; Skidmore, Donald C; > >>>>> e1000-devel@lists.sourceforge.net > >>>>> Subject: Re: [E1000-devel] ixgbe use only one queue for outgoing > >>>>> vlan when > >>>>> AtrSampleRate=0 > >>>>> > >>>>> TCP SYN packets. > >>>>> > >>>>> 12:08:48.943381 IP 48.67.232.4.32091 > 10.8.8.8.80: Flags [S], > >>>>> seq 657424593, win 124, length 0 > >>>>> 12:08:48.943386 IP 97.59.215.64.46040 > 10.8.8.8.80: Flags [S], > >>>>> seq 521664840, win 124, length 0 > >>>>> 12:08:48.943388 IP 40.204.199.121.57788 > 10.8.8.8.80: Flags [S], > >>>>> seq 16292676, win 124, length 0 > >>>>> 12:08:48.943390 IP 119.152.27.119.957 > 10.8.8.8.80: Flags [S], > >>>>> seq 383468976, win 124, length 0 > >>>>> 12:08:48.943392 IP 89.195.197.254.20641 > 10.8.8.8.80: Flags [S], > >>>>> seq 332509997, win 124, length 0 > >>>>> > >>>>> 12.12.2014 22:59, Tantilov, Emil S пишет: > >>>>>>> -----Original Message----- > >>>>>>> From: Viktor Khomyuk [mailto:v.khom...@office.ngs.ru] > >>>>>>> Sent: Thursday, December 11, 2014 8:39 PM > >>>>>>> To: Skidmore, Donald C; e1000-devel@lists.sourceforge.net > >>>>>>> Subject: Re: [E1000-devel] ixgbe use only one queue for outgoing > >>>>>>> vlan when AtrSampleRate=0 > >>>>>>> > >>>>>>> No, I generate traffic with random src ip and src port (but same > >>>>>>> dst ip and dst port). So I have many flows. > >>>>>> What protocol? > >>>>>> > >>>>>> Thanks, > >>>>>> Emil > >>>>>> > >>>>>> > >>>>> -- > >>>>> Хомюк Виктор > >>>>> Администратор веб-сервисов > >>>>> ЗАО "НГС" > >>>>> +7-913-787-79-29 > >>> -- > >>> Хомюк Виктор > >>> Администратор веб-сервисов > >>> ЗАО "НГС" > >>> +7-913-787-79-29 > >>> > >>> > >>> -------------------------------------------------------------------- > >>> -- > >>> -------- Download BIRT iHub F-Type - The Free Enterprise-Grade BIRT > >>> Server from Actuate! Instantly Supercharge Your Business Reports and > >>> Dashboards with Interactivity, Sharing, Native Excel Exports, App > >>> Integration & more Get technology previously reserved for > >>> billion-dollar corporations, FREE > >>> > >> > http://pubads.g.doubleclick.net/gampad/clk?id=164703151&iu=/4140/ostg. > >>> clktrk _______________________________________________ > >>> E1000-devel mailing list > >>> E1000-devel@lists.sourceforge.net > >>> https://lists.sourceforge.net/lists/listinfo/e1000-devel > >>> To learn more about Intel® Ethernet, visit > >>> http://communities.intel.com/community/wired > >> -- > >> Хомюк Виктор > >> Администратор веб-сервисов > >> ЗАО "НГС" > >> +7-913-787-79-29 > > -- > Хомюк Виктор > Администратор веб-сервисов > ЗАО "НГС" > +7-913-787-79-29 ------------------------------------------------------------------------------ Download BIRT iHub F-Type - The Free Enterprise-Grade BIRT Server from Actuate! Instantly Supercharge Your Business Reports and Dashboards with Interactivity, Sharing, Native Excel Exports, App Integration & more Get technology previously reserved for billion-dollar corporations, FREE http://pubads.g.doubleclick.net/gampad/clk?id=164703151&iu=/4140/ostg.clktrk _______________________________________________ E1000-devel mailing list E1000-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/e1000-devel To learn more about Intel® Ethernet, visit http://communities.intel.com/community/wired
