Re: Network Interface "Intel I350 Fiber" 8 Port Module shows only 4 Ports

[Marco Prause]

Hi,

I just wanted to keep you in loop concerning my "8 Port Module" problem.
To make a long story short:

One jumper on the motherboard did fix the issue \o/


I've just changed :

  two x8 signals

into

  one x8, two x4 signals

with the PCIe slot and tadaa all interfaces are present.



So, sorry for the noise.


Have a nice weekend,
Marco

Re: Network Interface "Intel I350 Fiber" 8 Port Module shows only 4 Ports

[Marco Prause]

Hi,

> Concerning my chipset problem, I'm compiling current at the moment,
> because the msi-x feature sounds very promising in this case.

current for amd64 is compiled and booted, but unfortunately I still see
just 4 of the 8 interfaces.

But, I also still see that they are using msi and not msi-x as I
supposed after reading :

  http://www.openbsd.org/plus.html

and

  http://permalink.gmane.org/gmane.os.openbsd.tech/50018


The card itself indicates the usage of msi-x at pcidump as you can see
on the first recognised chipset :

 2:0:3: Intel I350 Fiber
0x: Vendor ID: 8086 Product ID: 1522
0x0004: Command: 0006 Status: 0010
0x0008: Class: 02 Subclass: 00 Interface: 00 Revision: 01
0x000c: BIST: 00 Header Type: 80 Latency Timer: 00 Cache Line
Size: 10
0x0010: BAR mem 32bit addr: 0xf7d0/0x0002
0x0014: BAR empty ()
0x0018: BAR empty ()
0x001c: BAR mem 32bit addr: 0xf7d8/0x4000
0x0020: BAR empty ()
0x0024: BAR empty ()
0x0028: Cardbus CIS: 
0x002c: Subsystem Vendor ID:  Product ID: 
0x0030: Expansion ROM Base Address: 
0x0038: 
0x003c: Interrupt Pin: 04 Line: 0b Min Gnt: 00 Max Lat: 00
0x0040: Capability 0x01: Power Management
State: D0
0x0050: Capability 0x05: Message Signaled Interrupts (MSI)
0x0070: Capability 0x11: Extended Message Signaled Interrupts
(MSI-X)
0x00a0: Capability 0x10: PCI Express
Link Speed: 5.0 / 5.0 GT/s Link Width: x4 / x4



Maybe there's an option in the Bios setting I have to activate ?


Marco



> 
> Cheers,
> Marco
> 
> 
> Am 24.07.2016 um 22:20 schrieb Chris Cappuccio:
>> Marco Prause [marco-obsdm...@prause.eu] wrote:
>>
>>> em1: flags=18802 mtu 1500
>>> lladdr 00:90:0b:4b:54:0f
>>> priority: 0
>>> media: Ethernet autoselect (none)
>>> status: no carrier
>>> supported media:
>>> media 1000baseSX mediaopt full-duplex
>>> media 1000baseSX
>>> media autoselect
>>> #
>>>
>>> Having a look at the specification and em(4) I thought, it would be
>>> possible to connect e.g. 1000baseLX transceiver too.
>>> Does anybody know, if it is just because there's no 1000baseLX plugged
>>> in at the moment, or are there any limitations I should be aware of ?
>>>
>>
>> Yes it works fine. Perhaps you have an SX SFP installed at the moment?

Re: Network Interface "Intel I350 Fiber" 8 Port Module shows only 4 Ports

[Marco Prause]

Thanks Chris,

these are good news. And you are right, at the moment I've just
installed SX. I just thought, the output will show possible media types,
even if there's no corresponding sfp plugged in.
But I've ask the distributor to put a LX into the lab device, just to be
sure.

Concerning my chipset problem, I'm compiling current at the moment,
because the msi-x feature sounds very promising in this case.

Cheers,
Marco


Am 24.07.2016 um 22:20 schrieb Chris Cappuccio:
> Marco Prause [marco-obsdm...@prause.eu] wrote:
> 
>> em1: flags=18802 mtu 1500
>> lladdr 00:90:0b:4b:54:0f
>> priority: 0
>> media: Ethernet autoselect (none)
>> status: no carrier
>> supported media:
>> media 1000baseSX mediaopt full-duplex
>> media 1000baseSX
>> media autoselect
>> #
>>
>> Having a look at the specification and em(4) I thought, it would be
>> possible to connect e.g. 1000baseLX transceiver too.
>> Does anybody know, if it is just because there's no 1000baseLX plugged
>> in at the moment, or are there any limitations I should be aware of ?
>>
> 
> Yes it works fine. Perhaps you have an SX SFP installed at the moment?

Re: Network Interface "Intel I350 Fiber" 8 Port Module shows only 4 Ports

[Chris Cappuccio]

Marco Prause [marco-obsdm...@prause.eu] wrote:

> em1: flags=18802 mtu 1500
> lladdr 00:90:0b:4b:54:0f
> priority: 0
> media: Ethernet autoselect (none)
> status: no carrier
> supported media:
> media 1000baseSX mediaopt full-duplex
> media 1000baseSX
> media autoselect
> #
> 
> Having a look at the specification and em(4) I thought, it would be
> possible to connect e.g. 1000baseLX transceiver too.
> Does anybody know, if it is just because there's no 1000baseLX plugged
> in at the moment, or are there any limitations I should be aware of ?
> 

Yes it works fine. Perhaps you have an SX SFP installed at the moment?

Re: Network Interface "Intel I350 Fiber" 8 Port Module shows only 4 Ports

[Marco Prause]

Re,


> So, I've just adjusted my build scripts and jenkins-job and hit the
> build button a few minutes ago to build a 5.9 stable image (yes it's not
> current, but I didn't see any changes in plus.html concerning em
> interfaces or pci stuff, but this will be the next step.

just as a short actual information on this topic. Booted with 5.9, but I
still see just the first 4 interfaces that belong to the first chip on
the card :

 2:0:0: Intel I350 Fiber
 2:0:1: Intel I350 Fiber
 2:0:2: Intel I350 Fiber
 2:0:3: Intel I350 Fiber

em0 at pci2 dev 0 function 0 "Intel I350 Fiber" rev 0x01: msi, address
00:90:0b:4b:54:0e
em1 at pci2 dev 0 function 1 "Intel I350 Fiber" rev 0x01: msi, address
00:90:0b:4b:54:0f
em2 at pci2 dev 0 function 2 "Intel I350 Fiber" rev 0x01: msi, address
00:90:0b:4b:54:10
em3 at pci2 dev 0 function 3 "Intel I350 Fiber" rev 0x01: msi, address
00:90:0b:4b:54:11


Unfortunately I'm just connected to a remote lab, so I neither can't
check the Bios settings or version concerning any PCI stuff nor perform
a "normal" installation.


Another question arised while looking at the supported media-types:

# ifconfig em1 media
em1: flags=18802 mtu 1500
lladdr 00:90:0b:4b:54:0f
priority: 0
media: Ethernet autoselect (none)
status: no carrier
supported media:
media 1000baseSX mediaopt full-duplex
media 1000baseSX
media autoselect
#

Having a look at the specification and em(4) I thought, it would be
possible to connect e.g. 1000baseLX transceiver too.
Does anybody know, if it is just because there's no 1000baseLX plugged
in at the moment, or are there any limitations I should be aware of ?



So long,
Marco

Re: Network Interface "Intel I350 Fiber" 8 Port Module shows only 4 Ports

[Marco Prause]

Hi Nick,

Am 20.07.2016 um 14:08 schrieb Nick Holland:
> On 07/20/16 05:17, Marco Prause wrote:
>> Hi @Misc,
>>
>> I am quite happy to test a 8 Port interface-Card in a 1U Appliance.
>>
>> Unfortunately at the moment I just see 4 of the 8 interfaces - did
>> anybody already have some experience with this NICs and this behavior ?
> ...
>> OpenBSD 5.8-stable (FLASHRD.MP) #17: Thu Jul 14 11:17:43 CEST 2016
>> r...@obsd58build.my.domain:/usr/src/sys/arch/i386/compile/FLASHRD.MP
> ...
> 
> You will probably get a lot more interest in your report if you try
> again with a -current GENERIC.MP kernel, rather than a year old
> frankenkernel.  The problem -- if there ever was one in GENERIC -- may
> well have been fixed in the last year of development.  And never
> underestimate the amount of damage you can do by customizing things.

Good point, thanks.

I was just always sitting on the second to last release/stable version -
just like good old wine, but you are right in those cases it's better to
have a look at the newest release or even current. Nobody wants to do
the work that's already done.

Concerning the generic kernel, I didn't change the kernel or better it's
configuration intentionaly. I was just using flashrd to generate a
bootable image. (note to me: "have a look inside flashrd, what it is
doing there")

So, I've just adjusted my build scripts and jenkins-job and hit the
build button a few minutes ago to build a 5.9 stable image (yes it's not
current, but I didn't see any changes in plus.html concerning em
interfaces or pci stuff, but this will be the next step.

Best regards,
Marco

Re: Network Interface "Intel I350 Fiber" 8 Port Module shows only 4 Ports

[Nick Holland]

On 07/20/16 05:17, Marco Prause wrote:
> Hi @Misc,
> 
> I am quite happy to test a 8 Port interface-Card in a 1U Appliance.
> 
> Unfortunately at the moment I just see 4 of the 8 interfaces - did
> anybody already have some experience with this NICs and this behavior ?
...
> OpenBSD 5.8-stable (FLASHRD.MP) #17: Thu Jul 14 11:17:43 CEST 2016
> r...@obsd58build.my.domain:/usr/src/sys/arch/i386/compile/FLASHRD.MP
...

You will probably get a lot more interest in your report if you try
again with a -current GENERIC.MP kernel, rather than a year old
frankenkernel.  The problem -- if there ever was one in GENERIC -- may
well have been fixed in the last year of development.  And never
underestimate the amount of damage you can do by customizing things.

Nick.

Network Interface "Intel I350 Fiber" 8 Port Module shows only 4 Ports

[Marco Prause]

Hi @Misc,

I am quite happy to test a 8 Port interface-Card in a 1U Appliance.

Unfortunately at the moment I just see 4 of the 8 interfaces - did
anybody already have some experience with this NICs and this behavior ?

The spec lists the chipset as :

  8 GbE SFP Fiber   2 x Intel I350-AM4


And my OpenBSD 5.8 stable (from 2016-07-14) seems to see just one of
them as :

 "Intel I350 Fiber"


The recognized ports and the fixed RJ45-Ports work well so far.
But there's no indication that the second I350 chipset is recognized too.


Maybe anyone have a hint, if I can "activate" the second one (e.g.
fixing some interrupt-issues - which I didn't see so far, or any
different approach ?)

And last but nor least some dmesg and pcidump output :

# uname -a
OpenBSD gw 5.8 FLASHRD.MP#17 i386
#
# dmesg


OpenBSD 5.8-stable (FLASHRD.MP) #17: Thu Jul 14 11:17:43 CEST 2016
r...@obsd58build.my.domain:/usr/src/sys/arch/i386/compile/FLASHRD.MP
cpu0: Intel(R) Core(TM) i5-4570S CPU @ 2.90GHz ("GenuineIntel"
686-class) 2.91 GHz
cpu0:
FPU,V86,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,NXE,PAGE1GB,LONG,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,FMA3,CX16,xTPR,PDCM,PCID,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,LAHF,ABM,PERF,ITSC,FSGSBASE,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,SENSOR,ARAT
real mem  = 3680247808 (3509MB)
avail mem = 3592876032 (3426MB)
mpath0 at root
scsibus0 at mpath0: 256 targets
mainbus0 at root
bios0 at mainbus0: date 12/14/12, SMBIOS rev. 2.8 @ 0xec200 (78 entries)
bios0: vendor American Megatrends Inc. version "4.6.5" date 03/02/2015
bios0: INTEL Corporation DENLOW_WS
acpi0 at bios0: rev 2
acpi0: sleep states S0 S5
acpi0: tables DSDT FACP APIC FPDT SSDT MCFG HPET SSDT SSDT ASF! DMAR
EINJ ERST HEST BERT
acpi0: wakeup devices PS2K(S0) PS2M(S0) PXSX(S0) RP01(S0) PXSX(S0)
RP02(S0) PXSX(S0) RP03(S0) PXSX(S0) RP04(S0) PXSX(S0) RP05(S0) PXSX(S0)
RP06(S0) PXSX(S0) RP07(S0) [...]
acpitimer0 at acpi0: 3579545 Hz, 24 bits
acpimadt0 at acpi0 addr 0xfee0: PC-AT compat
cpu0 at mainbus0: apid 0 (boot processor)
mtrr: Pentium Pro MTRR support, 10 var ranges, 88 fixed ranges
cpu0: apic clock running at 99MHz
cpu0: mwait min=64, max=64, C-substates=0.2.1.2.4, IBE
cpu1 at mainbus0: apid 2 (application processor)
cpu1: Intel(R) Core(TM) i5-4570S CPU @ 2.90GHz ("GenuineIntel"
686-class) 2.90 GHz
cpu1:
FPU,V86,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,NXE,PAGE1GB,LONG,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,FMA3,CX16,xTPR,PDCM,PCID,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,LAHF,ABM,PERF,ITSC,FSGSBASE,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,SENSOR,ARAT
cpu2 at mainbus0: apid 4 (application processor)
cpu2: Intel(R) Core(TM) i5-4570S CPU @ 2.90GHz ("GenuineIntel"
686-class) 2.90 GHz
cpu2:
FPU,V86,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,NXE,PAGE1GB,LONG,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,FMA3,CX16,xTPR,PDCM,PCID,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,LAHF,ABM,PERF,ITSC,FSGSBASE,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,SENSOR,ARAT
cpu3 at mainbus0: apid 6 (application processor)
cpu3: Intel(R) Core(TM) i5-4570S CPU @ 2.90GHz ("GenuineIntel"
686-class) 2.90 GHz
cpu3:
FPU,V86,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,NXE,PAGE1GB,LONG,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,FMA3,CX16,xTPR,PDCM,PCID,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,LAHF,ABM,PERF,ITSC,FSGSBASE,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,SENSOR,ARAT
ioapic0 at mainbus0: apid 8 pa 0xfec0, version 20, 24 pins
acpimcfg0 at acpi0 addr 0xf800, bus 0-63
acpihpet0 at acpi0: 14318179 Hz
acpiprt0 at acpi0: bus 0 (PCI0)
acpiprt1 at acpi0: bus 3 (RP01)
acpiprt2 at acpi0: bus 4 (RP02)
acpiprt3 at acpi0: bus 5 (RP03)
acpiprt4 at acpi0: bus 6 (RP04)
acpiprt5 at acpi0: bus 7 (RP05)
acpiprt6 at acpi0: bus 8 (RP06)
acpiprt7 at acpi0: bus 9 (RP07)
acpiprt8 at acpi0: bus 1 (PEG0)
acpiprt9 at acpi0: bus 2 (PEG1)
acpiprt10 at acpi0: bus -1 (PEG2)
acpiec0 at acpi0: not present
acpicpu0 at acpi0: C1(@1 halt!)
acpicpu1 at acpi0: C1(@1 halt!)
acpicpu2 at acpi0: C1(@1 halt!)
acpicpu3 at acpi0: C1(@1 halt!)
acpipwrres at acpi0 not configured
acpipwrres at acpi0 not configured
acpipwrres at acpi0 not configured
acpipwrres at acpi0 not configured
acpipwrres at acpi0 not configured
acpitz0 at acpi0: critical temperature is 105 degC
acpitz1 at acpi0: critical temperature is 105 degC
acpibat0 at acpi0: BAT0 not present
acpibat1 at acpi0: BAT1 not present
acpibat2 at acpi0: BAT2 not present
acpibtn0 at acpi0: PWRB
acpibtn1 at acpi0: LID0
acpivideo0 at acpi0: GFX0
acpivout0 at acpivideo0: DD1F
bios0: ROM list: 0xc/0xec00
cpu0: Enhanced