Re: [E1000-devel] Intel 82599 AXX10GBNIAIOM cards for 10G SFPs UDP performance issue

2016-09-08 Thread Hank Liu
Hi Alex, see attached. thanks! Hank On Wed, Sep 7, 2016 at 7:32 PM, Alexander Duyck wrote: > Can you send me an lspci -vvv dump for the card. The main piece I am > interested in seeing is the link status register output. I just want > to verify that you are linked at x8 gen2. > > - Alex > >

Re: [E1000-devel] Intel 82599 AXX10GBNIAIOM cards for 10G SFPs UDP performance issue

2016-09-08 Thread Alexander Duyck
So the lspci looks good. It looks like everything is optimal there. >From what I can tell it looks like the NICs are in slots associated with NUMA node 0. So my thought on all this is that what is likely limiting your throughput is most likely the packet processing overhead associated with the fa

Re: [E1000-devel] Intel 82599 AXX10GBNIAIOM cards for 10G SFPs UDP performance issue

2016-09-08 Thread Skidmore, Donald C
Hey Hank, The reason I was interested in you results with parallel UPD netperf test is 1) if we didn’t see the problem there it would be a strong indication that the bottle neck is above the stack or 2) if we did see the same performance issue I would be able to recreate internally here. I’m n

Re: [E1000-devel] Intel 82599 AXX10GBNIAIOM cards for 10G SFPs UDP performance issue

2016-09-08 Thread Fujinaka, Todd
Attachments don't make it to the mailing list. You really should file a bug on sourceforge so more people can look at the information. Todd Fujinaka Software Application Engineer Networking Division (ND) Intel Corporation todd.fujin...@intel.com (503) 712-4565 -Original Message- From: Ha

Re: [E1000-devel] Intel 82599 AXX10GBNIAIOM cards for 10G SFPs UDP performance issue

2016-09-08 Thread Hank Liu
Hi Alex, I appreciate your input. As you pointed out that we would expect single queue and single xeon cpu core should be able to handle say 5-6G. Then, if RSS come in place, we should easily handle close to 10G. However, with 8 or 16 queues, I still get pause frame. Without any basic problems - w

Re: [E1000-devel] Intel 82599 AXX10GBNIAIOM cards for 10G SFPs UDP performance issue

2016-09-08 Thread Hank Liu
Hi Don, I already hacked the ixgbe driver but I don't expect that will make much difference. I am missing something still... May be I need to look hard on DPDK down the road, but for now, I am hoping there is a simple solution to get my product going... Hank On Thu, Sep 8, 2016 at 10:21 AM, Sk

Re: [E1000-devel] Intel 82599 AXX10GBNIAIOM cards for 10G SFPs UDP performance issue

2016-09-08 Thread Hank Liu
I forgot to ask a question about how to set interrupt modulation and make sure it's set. I get used to proset on Windows world. With linux, i use ethtool -C to set it but it only allow me to set rx-usecs, setting other fields like rx-frames, etc doesn't honor it. So, what is the right way to set i

Re: [E1000-devel] Intel 82599 AXX10GBNIAIOM cards for 10G SFPs UDP performance issue

2016-09-08 Thread Alexander Duyck
Hi Hank, So I don't think you quite understand how the protocol stack works. The driver operates in softirq context. Within that context we handle everything up to and including copying the incoming packet into the socket buffer. So when I say it is the socket layer having issues, what I mean is

Re: [E1000-devel] Intel 82599 AXX10GBNIAIOM cards for 10G SFPs UDP performance issue

2016-09-08 Thread Hank Liu
Hi Alex, I also think existing network stack overhead is too much for high BW network. However, I would thought that with system resource we have, Intel card should handle 1 x 10Gbps traffic regardless what type of traffic that is right out of the box. Thing I don't understand is that you kept say