Re: ixg(4) performances

2014-09-03 Thread Bert Kiers
On Sat, Aug 30, 2014 at 10:24:52AM +0100, Justin Cormack wrote: On Sat, Aug 30, 2014 at 8:22 AM, Thor Lancelot Simon t...@panix.com wrote: On Fri, Aug 29, 2014 at 12:22:31PM -0400, Terry Moore wrote: Is the ixg in an expansion slot or integrated onto the main board? If you know where to

Re: ixg(4) performances

2014-09-03 Thread Bert Kiers
On Wed, Sep 03, 2014 at 04:11:29PM +0200, Bert Kiers wrote: NetBSD 6.1 says: vendor 0x8086 product 0x1528 (ethernet network, revision 0x01) at pci1 dev 0 function 0 not configured Complete messages: http://netbsd.itsx.net/hw/x9drw.dmesg NetBSD current from today also does not configure

Re: ixg(4) performances

2014-09-03 Thread Emmanuel Dreyfus
On Wed, Sep 03, 2014 at 04:11:29PM +0200, Bert Kiers wrote: NetBSD 6.1 says: vendor 0x8086 product 0x1528 (ethernet network, revision 0x01) at pci1 dev 0 function 0 not configured In src/sys/dev/pci/ixgbe/ we know about producct Id 0x1529 and 0x152A but not 0x1528. But this can probably be

Re: ixg(4) performances

2014-09-03 Thread Masanobu SAITOH
On 2014/09/04 0:40, Emmanuel Dreyfus wrote: On Wed, Sep 03, 2014 at 04:11:29PM +0200, Bert Kiers wrote: NetBSD 6.1 says: vendor 0x8086 product 0x1528 (ethernet network, revision 0x01) at pci1 dev 0 function 0 not configured In src/sys/dev/pci/ixgbe/ we know about producct Id 0x1529 and

Re: ixg(4) performances

2014-09-03 Thread Masanobu SAITOH
On 2014/09/04 11:24, Masanobu SAITOH wrote: On 2014/09/04 0:40, Emmanuel Dreyfus wrote: On Wed, Sep 03, 2014 at 04:11:29PM +0200, Bert Kiers wrote: NetBSD 6.1 says: vendor 0x8086 product 0x1528 (ethernet network, revision 0x01) at pci1 dev 0 function 0 not configured In

Re: ixg(4) performances

2014-08-30 Thread Thor Lancelot Simon
On Fri, Aug 29, 2014 at 12:22:31PM -0400, Terry Moore wrote: Is the ixg in an expansion slot or integrated onto the main board? If you know where to get a mainboard with an integrated ixg, I wouldn't mind hearing about it. Thor

Re: ixg(4) performances

2014-08-30 Thread Justin Cormack
On Sat, Aug 30, 2014 at 8:22 AM, Thor Lancelot Simon t...@panix.com wrote: On Fri, Aug 29, 2014 at 12:22:31PM -0400, Terry Moore wrote: Is the ixg in an expansion slot or integrated onto the main board? If you know where to get a mainboard with an integrated ixg, I wouldn't mind hearing

Re: ixg(4) performances

2014-08-30 Thread Matthias Drochner
On Fri, 29 Aug 2014 15:51:14 + Emmanuel Dreyfus m...@netbsd.org wrote: I found this, but the result does not make sense: negociated max ... Link Capabilities Ragister (0xAC): 0x00027482 bits 3:0 Supprted Link speed: 0010 = 5 GbE and 2.5 GbE speed supported bits 9:4 Max link width:

Re: ixg(4) performances

2014-08-30 Thread Emmanuel Dreyfus
Matthias Drochner m.droch...@fz-juelich.de wrote: Link Capabilities Ragister (0xAC): 0x00027482 bits 3:0 Supprted Link speed: 0010 = 5 GbE and 2.5 GbE speed supported bits 9:4 Max link width: 001000 = x4 Wrong -- this means x8. bits 14:12 L0s exit lattency: 101 = 1 µs - 2 µs

RE: ixg(4) performances

2014-08-29 Thread Terry Moore
-Original Message- From: tech-kern-ow...@netbsd.org [mailto:tech-kern-ow...@netbsd.org] On Behalf Of Emmanuel Dreyfus Sent: Thursday, August 28, 2014 23:55 To: Terry Moore; 'Christos Zoulas' Cc: tech-kern@netbsd.org Subject: Re: ixg(4) performances Terry Moore t...@mcci.com

Re: ixg(4) performances

2014-08-29 Thread Emmanuel Dreyfus
On Fri, Aug 29, 2014 at 08:48:51AM -0400, Terry Moore wrote: Still, you should check whether you have the right number of the right generation of PCIe lanes connected to the ixg. I found this, but the result does not make sense: negociated max ... Link Capabilities Ragister (0xAC):

RE: ixg(4) performances

2014-08-29 Thread Terry Moore
On Friday, August 29, 2014 11:51, Emmanuel Dreyfus wrote: On Fri, Aug 29, 2014 at 08:48:51AM -0400, Terry Moore wrote: Still, you should check whether you have the right number of the right generation of PCIe lanes connected to the ixg. I found this, but the result does not make sense:

Re: ixg(4) performances

2014-08-29 Thread Emmanuel Dreyfus
Terry Moore t...@mcci.com wrote: But it's running at gen1. I strongly suspect that the benchmark case was gen2 (since the ixg is capable of it). gen1 vs gen2 is 2.5 Gb.s bs 5 Gb/s? Is the ixg in an expansion slot or integrated onto the main board? In a slot. -- Emmanuel Dreyfus

Re: ixg(4) performances

2014-08-29 Thread Hisashi T Fujinaka
On Fri, 29 Aug 2014, Emmanuel Dreyfus wrote: Terry Moore t...@mcci.com wrote: But it's running at gen1. I strongly suspect that the benchmark case was gen2 (since the ixg is capable of it). gen1 vs gen2 is 2.5 Gb.s bs 5 Gb/s? Gen 1 is capable of only 2.5GT/s (gigatransfers per second).

Re: ixg(4) performances

2014-08-28 Thread Emmanuel Dreyfus
On Tue, Aug 26, 2014 at 12:57:37PM +, Christos Zoulas wrote: I also found this page that tackles the same problem on Linux: http://dak1n1.com/blog/7-performance-tuning-intel-10gbe It seems that page describe a slightly different model. Intel 82599 datasheet is available here:

Re: ixg(4) performances

2014-08-28 Thread Emmanuel Dreyfus
On Tue, Aug 26, 2014 at 04:40:25PM +, Taylor R Campbell wrote: New version with some changes suggested by wiz@. Anyone has objection to this change being committed and pulled up to netbsd-7? -- Emmanuel Dreyfus m...@netbsd.org

Re: ixg(4) performances

2014-08-28 Thread Stephan
What is your test setup? Do you have 2 identical boxes? Does it perform better e.g. on Linux or FreeBSD? If so, you could check how the config registers get set by that particular OS. 2014-08-28 9:26 GMT+02:00 Emmanuel Dreyfus m...@netbsd.org: On Tue, Aug 26, 2014 at 12:57:37PM +, Christos

RE: ixg(4) performances

2014-08-28 Thread Terry Moore
Or the performance are constrained by something unrelated. In the blog post cited above, the poster acheived more than 5 Gb/s before touching MMRBC, while I am stuck at 2,7 GB/s. Any new idea welcome. The blog post refers to PCI-X, I'm more familiar with PCIe, but the concepts are similar.

Re: ixg(4) performances

2014-08-28 Thread Christos Zoulas
In article 20140828072832.gi8...@homeworld.netbsd.org, Emmanuel Dreyfus m...@netbsd.org wrote: On Tue, Aug 26, 2014 at 04:40:25PM +, Taylor R Campbell wrote: New version with some changes suggested by wiz@. Anyone has objection to this change being committed and pulled up to netbsd-7? Not

Re: ixg(4) performances

2014-08-28 Thread Hisashi T Fujinaka
On Thu, 28 Aug 2014, Emmanuel Dreyfus wrote: On Tue, Aug 26, 2014 at 12:57:37PM +, Christos Zoulas wrote: I also found this page that tackles the same problem on Linux: http://dak1n1.com/blog/7-performance-tuning-intel-10gbe It seems that page describe a slightly different model. Intel

Re: ixg(4) performances

2014-08-28 Thread Emmanuel Dreyfus
On Thu, Aug 28, 2014 at 08:37:06AM -0700, Hisashi T Fujinaka wrote: Isn't your PCIe slot constrained? I thought I remembered that you're only getting 2.5GT/s and I forget what test you're running. I use netperf, and I now get 2.7 Gb/s. -- Emmanuel Dreyfus m...@netbsd.org

Re: ixg(4) performances

2014-08-28 Thread Emmanuel Dreyfus
Terry Moore t...@mcci.com wrote: There are several possibilities, all revolving about differences between the blog poster's base system and yorus. Do I have a way to investigate for appropriate PCI setup? Here is what dmesg says about it: pci0 at mainbus0 bus 0: configuration mode 1 pci0: i/o

Re: ixg(4) performances

2014-08-27 Thread Emmanuel Dreyfus
On Tue, Aug 26, 2014 at 04:40:25PM +, Taylor R Campbell wrote: How about the attached patch? I've been sitting on this for months. Both changes seem fine, but the board does not behave as told by Linux crowd. At 0xe6 is a nul value where we should have 0x22, and attemps to change it does

Re: ixg(4) performances

2014-08-26 Thread Emmanuel Dreyfus
On Tue, Aug 26, 2014 at 12:57:37PM +, Christos Zoulas wrote: ftp://ftp.supermicro.com/CDR-C2_1.20_for_Intel_C2_platform/Intel/LAN/v15.5/PROXGB/DOCS/SERVER/prform10.htm#Setting_MMRBC Right, but NetBSD has no tool like Linux's setpci to tweak MMRBC, and if the BIOS has no setting for it,

Re: ixg(4) performances

2014-08-26 Thread Christos Zoulas
On Aug 26, 2:23pm, m...@netbsd.org (Emmanuel Dreyfus) wrote: -- Subject: Re: ixg(4) performances | On Tue, Aug 26, 2014 at 12:57:37PM +, Christos Zoulas wrote: | ftp://ftp.supermicro.com/CDR-C2_1.20_for_Intel_C2_platform/Intel/LAN/v15.5/PROXGB/DOCS/SERVER/prform10.htm#Setting_MMRBC

Re: ixg(4) performances

2014-08-26 Thread Christos Zoulas
On Aug 26, 2:42pm, m...@netbsd.org (Emmanuel Dreyfus) wrote: -- Subject: Re: ixg(4) performances | On Tue, Aug 26, 2014 at 10:25:52AM -0400, Christos Zoulas wrote: | I would probably extend pcictl with cfgread and cfgwrite commands. | | Sure, once it works I can do that, but a first attempt

Re: ixg(4) performances

2014-08-26 Thread Taylor R Campbell
Date: Tue, 26 Aug 2014 10:25:52 -0400 From: chris...@zoulas.com (Christos Zoulas) On Aug 26, 2:23pm, m...@netbsd.org (Emmanuel Dreyfus) wrote: -- Subject: Re: ixg(4) performances | I see dev/pci/pciio.h has a PCI_IOC_CFGREAD / PCI_IOC_CFGWRITE ioctl, | does that means Linux's

Re: ixg(4) performances

2014-08-26 Thread Emmanuel Dreyfus
On Tue, Aug 26, 2014 at 11:13:50AM -0400, Christos Zoulas wrote: I think in the example that was 0xe6. I think the .b means byte access (I am guessing). Yes, I came to that conclusion reading pciutils sources. I discovered they also had a man page explaining that -) I think that we are only

Re: ixg(4) performances

2014-08-26 Thread Taylor R Campbell
Date: Tue, 26 Aug 2014 15:40:41 + From: Taylor R Campbell riastr...@netbsd.org How about the attached patch? I've been sitting on this for months. New version with some changes suggested by wiz@. Index: usr.sbin/pcictl/pcictl.8

Re: ixg(4) performances

2014-08-26 Thread Taylor R Campbell
Date: Tue, 26 Aug 2014 14:42:55 + From: Emmanuel Dreyfus m...@netbsd.org On Tue, Aug 26, 2014 at 10:25:52AM -0400, Christos Zoulas wrote: I would probably extend pcictl with cfgread and cfgwrite commands. Sure, once it works I can do that, but a first attempt just ets

Re: ixg(4) performances

2014-08-26 Thread David Young
On Tue, Aug 26, 2014 at 10:25:52AM -0400, Christos Zoulas wrote: On Aug 26, 2:23pm, m...@netbsd.org (Emmanuel Dreyfus) wrote: -- Subject: Re: ixg(4) performances | On Tue, Aug 26, 2014 at 12:57:37PM +, Christos Zoulas wrote: | ftp://ftp.supermicro.com/CDR

re: ixg(4) performances

2014-08-26 Thread matthew green
Finally, adding cfgread/cfgwrite commands to pcictl seems like a step in the wrong direction. I know that this is UNIX and we're duty-bound to give everyone enough rope, but may we reconsider our assisted-suicide policy just this one time? :-) How well has blindly poking configuration

Re: ixg(4) performances

2014-08-26 Thread Hisashi T Fujinaka
On Tue, 26 Aug 2014, David Young wrote: How well has blindly poking configuration registers worked for us in the past? Well, with the part he's using (the 82599, I think) it shouldn't be that blind. The datasheet has all the registers listed, which is the case for most of Intel's Ethernet

Re: ixg(4) performances

2014-08-26 Thread Thor Lancelot Simon
On Tue, Aug 26, 2014 at 12:17:28PM +, Emmanuel Dreyfus wrote: Hi ixgb(4) has poor performances, even on latest -current. Here is the dmesg output: ixg1 at pci5 dev 0 function 1: Intel(R) PRO/10GbE PCI-Express Network Driver, Version - 2.3.10 ixg1: clearing prefetchable bit ixg1:

Re: ixg(4) performances

2014-08-26 Thread Thor Lancelot Simon
On Tue, Aug 26, 2014 at 07:03:06PM -0700, Jonathan Stone wrote: Thor, The NetBSD TCP stack can't handle 8K payload by page-flipping the payload and prepending an mbuf for XDR/NFS/TCP/IP headers? Or is the issue the extra page-mapping for the prepended mbuf? The issue is allocating the

Re: ixg(4) performances

2014-08-26 Thread Taylor R Campbell
Date: Tue, 26 Aug 2014 12:44:43 -0500 From: David Young dyo...@pobox.com Finally, adding cfgread/cfgwrite commands to pcictl seems like a step in the wrong direction. I know that this is UNIX and we're duty-bound to give everyone enough rope, but may we reconsider our

Re: ixg(4) performances

2014-08-26 Thread Jonathan Stone
wrote: Subject: Re: ixg(4) performances To: Emmanuel Dreyfus m...@netbsd.org Cc: tech-kern@netbsd.org Date: Tuesday, August 26, 2014, 6:56 PM [...] MTU 9000 considered harmful.  Use something that fits in 8K with the headers. It's a minor piece of the puzzle but nonetheless, it's a piece

Re: ixg(4) performances

2014-08-26 Thread Emmanuel Dreyfus
Thor Lancelot Simon t...@panix.com wrote: MTU 9000 considered harmful. Use something that fits in 8K with the headers. It's a minor piece of the puzzle but nonetheless, it's a piece. mtu 8192 or 8000 does not cause any improvement over mtu 9000. -- Emmanuel Dreyfus