I ran into a rather strange issue when upgrading a Sun Fire X4150 from
(gentoo kernel versions) 2.6.33-r2 to 2.6.34-r1 this week. After
booting the new kernel, only two of the four interfaces came up. After
some troubleshooting, the culprit appeared to be our kernel options for
printing messages to the console, "console=tty0 console=ttyS0,9600n8".
If I remove these options, all four interfaces come up. During
testing, though, I booted a 2.6.30 Arch install ISO and had the same
problem. I'm not sure what's going wrong here, but it's incredibly
frustrating, as the interfaces that don't appear are the first two, so
the machine never appears on the network.
The only significant thing I can see is that, when it doesn't work, the
bus it appears on isn't the same as when it does work. Any ideas or
suggestions?
Here's the syslog output from various boot attempts and some lspci -vvv
output.
2.6.34 with options (two NICs gone):
Jul 21 10:02:47 sunshine kernel: e1000e: Intel(R) PRO/1000 Network Driver -
1.0.2-k2
Jul 21 10:02:47 sunshine kernel: e1000e: Copyright (c) 1999 - 2009 Intel
Corporation.
Jul 21 10:02:47 sunshine kernel: e1000e 0000:0a:00.0: Disabling ASPM L1
Jul 21 10:02:47 sunshine kernel: e1000e 0000:0a:00.0: PCI INT A -> GSI 16
(level, low) -> IRQ 16
Jul 21 10:02:47 sunshine kernel: e1000e 0000:0a:00.0: setting latency timer to
64
Jul 21 10:02:47 sunshine kernel: e1000e 0000:0a:00.0: irq 56 for MSI/MSI-X
Jul 21 10:02:48 sunshine kernel: 0000:0a:00.0: eth0: (PCI Express:2.5GB/s:Width
x4) 00:23:8b:77:49:d0
Jul 21 10:02:48 sunshine kernel: 0000:0a:00.0: eth0: Intel(R) PRO/1000 Network
Connection
Jul 21 10:02:48 sunshine kernel: 0000:0a:00.0: eth0: MAC: 0, PHY: 4, PBA No:
c83246-002
Jul 21 10:02:48 sunshine kernel: e1000e 0000:0a:00.1: Disabling ASPM L1
Jul 21 10:02:48 sunshine kernel: e1000e 0000:0a:00.1: PCI INT B -> GSI 17
(level, low) -> IRQ 17
Jul 21 10:02:48 sunshine kernel: e1000e 0000:0a:00.1: setting latency timer to
64
Jul 21 10:02:48 sunshine kernel: e1000e 0000:0a:00.1: irq 57 for MSI/MSI-X
Jul 21 10:02:48 sunshine kernel: 0000:0a:00.1: eth1: (PCI Express:2.5GB/s:Width
x4) 00:23:8b:77:49:d1
Jul 21 10:02:48 sunshine kernel: 0000:0a:00.1: eth1: Intel(R) PRO/1000 Network
Connection
Jul 21 10:02:48 sunshine kernel: 0000:0a:00.1: eth1: MAC: 0, PHY: 4, PBA No:
c83246-002
Jul 21 10:02:49 sunshine kernel: udev: renamed network interface eth1 to eth3
Jul 21 10:02:49 sunshine kernel: udev: renamed network interface eth0 to eth2
2.6.34 without options (working):
Jul 21 10:11:09 sunshine kernel: e1000e: Intel(R) PRO/1000 Network Driver -
1.0.2-k2
Jul 21 10:11:09 sunshine kernel: e1000e: Copyright (c) 1999 - 2009 Intel
Corporation.
Jul 21 10:11:09 sunshine kernel: e1000e 0000:04:00.0: PCI INT A -> GSI 18
(level, low) -> IRQ 18
Jul 21 10:11:09 sunshine kernel: e1000e 0000:04:00.0: setting latency timer to
64
Jul 21 10:11:09 sunshine kernel: e1000e 0000:04:00.0: irq 57 for MSI/MSI-X
... (a USB keyboard comes up right here)
Jul 21 10:11:09 sunshine kernel: 0000:04:00.0: eth0: (PCI Express:2.5GB/s:Width
x1) 00:23:8b:77:49:ce
Jul 21 10:11:09 sunshine kernel: 0000:04:00.0: eth0: Intel(R) PRO/1000 Network
Connection
Jul 21 10:11:09 sunshine kernel: 0000:04:00.0: eth0: MAC: 5, PHY: 5, PBA No:
ffffff-0ff
Jul 21 10:11:09 sunshine kernel: e1000e 0000:04:00.1: PCI INT B -> GSI 19
(level, low) -> IRQ 19
Jul 21 10:11:09 sunshine kernel: e1000e 0000:04:00.1: setting latency timer to
64
Jul 21 10:11:09 sunshine kernel: e1000e 0000:04:00.1: irq 58 for MSI/MSI-X
Jul 21 10:11:09 sunshine kernel: 0000:04:00.1: eth1: (PCI Express:2.5GB/s:Width
x1) 00:23:8b:77:49:cf
Jul 21 10:11:09 sunshine kernel: 0000:04:00.1: eth1: Intel(R) PRO/1000 Network
Connection
Jul 21 10:11:09 sunshine kernel: 0000:04:00.1: eth1: MAC: 5, PHY: 5, PBA No:
ffffff-0ff
Jul 21 10:11:09 sunshine kernel: e1000e 0000:0b:00.0: Disabling ASPM L1
Jul 21 10:11:09 sunshine kernel: e1000e 0000:0b:00.0: PCI INT A -> GSI 16
(level, low) -> IRQ 16
Jul 21 10:11:09 sunshine kernel: e1000e 0000:0b:00.0: setting latency timer to
64
Jul 21 10:11:09 sunshine kernel: e1000e 0000:0b:00.0: irq 59 for MSI/MSI-X
Jul 21 10:11:09 sunshine kernel: scsi 1:0:0:0: CD-ROM TSSTcorp
CD/DVDW TS-T632A SR03 PQ: 0 ANSI: 0
Jul 21 10:11:09 sunshine kernel: 0000:0b:00.0: eth2: (PCI Express:2.5GB/s:Width
x4) 00:23:8b:77:49:d0
Jul 21 10:11:09 sunshine kernel: 0000:0b:00.0: eth2: Intel(R) PRO/1000 Network
Connection
Jul 21 10:11:09 sunshine kernel: 0000:0b:00.0: eth2: MAC: 0, PHY: 4, PBA No:
c83246-002
Jul 21 10:11:09 sunshine kernel: e1000e 0000:0b:00.1: Disabling ASPM L1
Jul 21 10:11:09 sunshine kernel: e1000e 0000:0b:00.1: PCI INT B -> GSI 17
(level, low) -> IRQ 17
Jul 21 10:11:09 sunshine kernel: e1000e 0000:0b:00.1: setting latency timer to
64
Jul 21 10:11:09 sunshine kernel: e1000e 0000:0b:00.1: irq 60 for MSI/MSI-X
Jul 21 10:11:09 sunshine kernel: 0000:0b:00.1: eth3: (PCI Express:2.5GB/s:Width
x4) 00:23:8b:77:49:d1
Jul 21 10:11:09 sunshine kernel: 0000:0b:00.1: eth3: Intel(R) PRO/1000 Network
Connection
Jul 21 10:11:09 sunshine kernel: 0000:0b:00.1: eth3: MAC: 0, PHY: 4, PBA No:
c83246-002
lspci -vvv output for the four interfaces (collected from 2.6.33):
04:00.0 Ethernet controller: Intel Corporation 80003ES2LAN Gigabit Ethernet
Controller (Copper) (rev 01)
Subsystem: Sun Microsystems Computer Corp. Device 4843
Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+
Stepping- SERR+ FastB2B- DisINTx+
Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort-
<MAbort- >SERR- <PERR- INTx-
Latency: 0, Cache Line Size: 64 bytes
Interrupt: pin A routed to IRQ 57
Region 0: Memory at fc6e0000 (32-bit, non-prefetchable) [size=128K]
Region 2: I/O ports at 9c00 [size=32]
Capabilities: [c8] Power Management version 2
Flags: PMEClk- DSI+ D1- D2- AuxCurrent=0mA
PME(D0+,D1-,D2-,D3hot+,D3cold+)
Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=1 PME-
Capabilities: [d0] MSI: Enable+ Count=1/1 Maskable- 64bit+
Address: 00000000fee0100c Data: 414a
Capabilities: [e0] Express (v1) Endpoint, MSI 00
DevCap: MaxPayload 256 bytes, PhantFunc 0, Latency L0s <512ns,
L1 <64us
ExtTag- AttnBtn- AttnInd- PwrInd- RBE- FLReset-
DevCtl: Report errors: Correctable+ Non-Fatal+ Fatal+
Unsupported+
RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop+
MaxPayload 128 bytes, MaxReadReq 512 bytes
DevSta: CorrErr- UncorrErr+ FatalErr- UnsuppReq+ AuxPwr+
TransPend-
LnkCap: Port #0, Speed 2.5GT/s, Width x4, ASPM unknown, Latency
L0 <128ns, L1 <64us
ClockPM- Surprise- LLActRep- BwNot-
LnkCtl: ASPM Disabled; RCB 64 bytes Disabled- Retrain- CommClk-
ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
LnkSta: Speed 2.5GT/s, Width x1, TrErr- Train- SlotClk+
DLActive- BWMgmt- ABWMgmt-
Capabilities: [100] Advanced Error Reporting
UESta: DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt-
RxOF- MalfTLP- ECRC- UnsupReq+ ACSViol-
UEMsk: DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt-
RxOF- MalfTLP- ECRC- UnsupReq+ ACSViol-
UESvrt: DLP+ SDES- TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt-
RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
CESta: RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr-
CEMsk: RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr-
AERCap: First Error Pointer: 14, GenCap- CGenEn- ChkCap- ChkEn-
Capabilities: [140] Device Serial Number 00-23-8b-ff-ff-77-49-ce
Kernel driver in use: e1000e
Kernel modules: e1000e
04:00.1 Ethernet controller: Intel Corporation 80003ES2LAN Gigabit Ethernet
Controller (Copper) (rev 01)
Subsystem: Sun Microsystems Computer Corp. Device 4843
Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+
Stepping- SERR+ FastB2B- DisINTx+
Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort-
<MAbort- >SERR- <PERR- INTx-
Latency: 0, Cache Line Size: 64 bytes
Interrupt: pin B routed to IRQ 58
Region 0: Memory at fc6c0000 (32-bit, non-prefetchable) [size=128K]
Region 2: I/O ports at 9800 [size=32]
Capabilities: [c8] Power Management version 2
Flags: PMEClk- DSI+ D1- D2- AuxCurrent=0mA
PME(D0+,D1-,D2-,D3hot+,D3cold+)
Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=1 PME-
Capabilities: [d0] MSI: Enable+ Count=1/1 Maskable- 64bit+
Address: 00000000feeff00c Data: 41d9
Capabilities: [e0] Express (v1) Endpoint, MSI 00
DevCap: MaxPayload 256 bytes, PhantFunc 0, Latency L0s <512ns,
L1 <64us
ExtTag- AttnBtn- AttnInd- PwrInd- RBE- FLReset-
DevCtl: Report errors: Correctable+ Non-Fatal+ Fatal+
Unsupported+
RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop+
MaxPayload 128 bytes, MaxReadReq 512 bytes
DevSta: CorrErr- UncorrErr+ FatalErr- UnsuppReq+ AuxPwr+
TransPend-
LnkCap: Port #0, Speed 2.5GT/s, Width x4, ASPM unknown, Latency
L0 <128ns, L1 <64us
ClockPM- Surprise- LLActRep- BwNot-
LnkCtl: ASPM Disabled; RCB 64 bytes Disabled- Retrain- CommClk-
ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
LnkSta: Speed 2.5GT/s, Width x1, TrErr- Train- SlotClk+
DLActive- BWMgmt- ABWMgmt-
Capabilities: [100] Advanced Error Reporting
UESta: DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt-
RxOF- MalfTLP- ECRC- UnsupReq+ ACSViol-
UEMsk: DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt-
RxOF- MalfTLP- ECRC- UnsupReq+ ACSViol-
UESvrt: DLP+ SDES- TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt-
RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
CESta: RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr-
CEMsk: RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr-
AERCap: First Error Pointer: 14, GenCap- CGenEn- ChkCap- ChkEn-
Capabilities: [140] Device Serial Number 00-23-8b-ff-ff-77-49-ce
Kernel driver in use: e1000e
Kernel modules: e1000e
0b:00.0 Ethernet controller: Intel Corporation 82571EB Gigabit Ethernet
Controller (rev 06)
Subsystem: Sun Microsystems Computer Corp. Device 125e
Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+
Stepping- SERR+ FastB2B- DisINTx+
Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort-
<MAbort- >SERR- <PERR- INTx-
Latency: 0, Cache Line Size: 64 bytes
Interrupt: pin A routed to IRQ 59
Region 0: Memory at fcde0000 (32-bit, non-prefetchable) [size=128K]
Region 1: Memory at fcdc0000 (32-bit, non-prefetchable) [size=128K]
Region 2: I/O ports at ac00 [size=32]
Expansion ROM at fcda0000 [disabled] [size=128K]
Capabilities: [c8] Power Management version 2
Flags: PMEClk- DSI+ D1- D2- AuxCurrent=0mA
PME(D0+,D1-,D2-,D3hot+,D3cold+)
Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=1 PME-
Capabilities: [d0] MSI: Enable+ Count=1/1 Maskable- 64bit+
Address: 00000000feeff00c Data: 41e1
Capabilities: [e0] Express (v1) Endpoint, MSI 00
DevCap: MaxPayload 256 bytes, PhantFunc 0, Latency L0s <512ns,
L1 <64us
ExtTag- AttnBtn- AttnInd- PwrInd- RBE- FLReset-
DevCtl: Report errors: Correctable+ Non-Fatal+ Fatal+
Unsupported+
RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop+
MaxPayload 128 bytes, MaxReadReq 512 bytes
DevSta: CorrErr- UncorrErr+ FatalErr- UnsuppReq+ AuxPwr+
TransPend-
LnkCap: Port #0, Speed 2.5GT/s, Width x4, ASPM L0s, Latency L0
<4us, L1 <64us
ClockPM- Surprise- LLActRep- BwNot-
LnkCtl: ASPM Disabled; RCB 64 bytes Disabled- Retrain- CommClk-
ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
LnkSta: Speed 2.5GT/s, Width x4, TrErr- Train- SlotClk+
DLActive- BWMgmt- ABWMgmt-
Capabilities: [100] Advanced Error Reporting
UESta: DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt-
RxOF- MalfTLP- ECRC- UnsupReq+ ACSViol-
UEMsk: DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt-
RxOF- MalfTLP- ECRC- UnsupReq+ ACSViol-
UESvrt: DLP+ SDES- TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt-
RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
CESta: RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr-
CEMsk: RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr-
AERCap: First Error Pointer: 14, GenCap- CGenEn- ChkCap- ChkEn-
Capabilities: [140] Device Serial Number 00-23-8b-ff-ff-77-49-d0
Kernel driver in use: e1000e
Kernel modules: e1000e
0b:00.1 Ethernet controller: Intel Corporation 82571EB Gigabit Ethernet
Controller (rev 06)
Subsystem: Sun Microsystems Computer Corp. Device 125e
Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+
Stepping- SERR+ FastB2B- DisINTx+
Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort-
<MAbort- >SERR- <PERR- INTx-
Latency: 0, Cache Line Size: 64 bytes
Interrupt: pin B routed to IRQ 60
Region 0: Memory at fcd80000 (32-bit, non-prefetchable) [size=128K]
Region 1: Memory at fcd60000 (32-bit, non-prefetchable) [size=128K]
Region 2: I/O ports at a800 [size=32]
Expansion ROM at fcd40000 [disabled] [size=128K]
Capabilities: [c8] Power Management version 2
Flags: PMEClk- DSI+ D1- D2- AuxCurrent=0mA
PME(D0+,D1-,D2-,D3hot+,D3cold+)
Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=1 PME-
Capabilities: [d0] MSI: Enable+ Count=1/1 Maskable- 64bit+
Address: 00000000feeff00c Data: 41e9
Capabilities: [e0] Express (v1) Endpoint, MSI 00
DevCap: MaxPayload 256 bytes, PhantFunc 0, Latency L0s <512ns,
L1 <64us
ExtTag- AttnBtn- AttnInd- PwrInd- RBE- FLReset-
DevCtl: Report errors: Correctable+ Non-Fatal+ Fatal+
Unsupported+
RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop+
MaxPayload 128 bytes, MaxReadReq 512 bytes
DevSta: CorrErr- UncorrErr+ FatalErr- UnsuppReq+ AuxPwr+
TransPend-
LnkCap: Port #0, Speed 2.5GT/s, Width x4, ASPM L0s, Latency L0
<4us, L1 <64us
ClockPM- Surprise- LLActRep- BwNot-
LnkCtl: ASPM Disabled; RCB 64 bytes Disabled- Retrain- CommClk-
ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
LnkSta: Speed 2.5GT/s, Width x4, TrErr- Train- SlotClk+
DLActive- BWMgmt- ABWMgmt-
Capabilities: [100] Advanced Error Reporting
UESta: DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt-
RxOF- MalfTLP- ECRC- UnsupReq+ ACSViol-
UEMsk: DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt-
RxOF- MalfTLP- ECRC- UnsupReq+ ACSViol-
UESvrt: DLP+ SDES- TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt-
RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
CESta: RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr-
CEMsk: RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr-
AERCap: First Error Pointer: 14, GenCap- CGenEn- ChkCap- ChkEn-
Capabilities: [140] Device Serial Number 00-23-8b-ff-ff-77-49-d0
Kernel driver in use: e1000e
Kernel modules: e1000e
------------------------------------------------------------------------------
This SF.net email is sponsored by Sprint
What will you do first with EVO, the first 4G phone?
Visit sprint.com/first -- http://p.sf.net/sfu/sprint-com-first
_______________________________________________
E1000-devel mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/e1000-devel
To learn more about Intel® Ethernet, visit
http://communities.intel.com/community/wired
