I can try. Theo also sent me some ideas to try which involved cutting out PCI Express hotplug support from
sys/dev/pci/ppb.c Do you have reason to believe this has been fixed? -Jim On 1/11/13 8:25 AM, Sebastian Benoit wrote: > Jim Miller([email protected]) on 2013.01.09 15:20:03 -0500: >> Hi All, >> >> I saw a previous post back in late December where someone was discussing >> a random panic() related to msi_delroute(). I'm having the same problem >> I believe on a OpenBSD 5.1 box. The panic manifests itself about every >> week but no I can't find any specific event that is the cause. It >> appears related to the em driver thinking it is being removed. Any >> ideas or suggestions on how to debug this further? > Can you reproduce it with a -current snapshot? > > /Benno > >> ddb{2}> trace >> Debugger() at Debugger+0x5 >> panic() at panic+0xe4 >> msi_delroute() at msi_delroute+0x54 >> intr_disestablish() at intr_disestablish+0xe9 >> em_detach() at em_detach+0x26 >> config_detach() at config_detach+0x143 >> config_detach_children() at config_detach_children+0x3e >> pci_detach_devices() at pci_detach_devices+0x15 >> ppb_hotplug_remove() at ppb_hotplug_remove+0x26 >> workq_thread() at workq_thread+0x33 >> end trace frame: 0x0, count: -10 >> >> ddb{2}> show panic >> msi_delroute: no msi capability >> >> ddb{2}> machine ddbcpu 1 >> Stopped at Debugger+0x5: leave >> RUN AT LEAST 'trace' AND 'ps' AND INCLUDE OUTPUT WHEN REPORTING THIS PANIC! >> IF RUNNING SMP, USE 'mach ddbcpu <#>' AND 'trace' ON OTHER PROCESSORS, TOO. >> DO NOT EVEN BOTHER REPORTING THIS WITHOUT INCLUDING THAT INFORMATION! >> >> ddb{1}> ps >> PID PPID PGRP UID S FLAGS WAIT COMMAND >> 7473 31910 7473 0 3 0x80 ttyin bash >> 21722 31910 21722 0 3 0x80 ttyin bash >> 31910 1 31910 0 3 0x80 select screen >> 5621 1 5621 0 3 0x80 ttyin getty >> 6818 1 6818 0 3 0x80 select sendmail >> 27397 1 27397 0 3 0x80 ttyin getty >> 18642 1 18642 0 3 0x80 ttyin getty >> 20939 1 20939 0 3 0x80 ttyin getty >> 19043 1 19043 0 3 0x80 ttyin getty >> 22270 1 22270 0 3 0x80 ttyin getty >> 13738 1 13738 0 3 0x80 select cron >> 17462 1 17462 99 3 0x80 poll sndiod >> 25578 1 25578 0 3 0x80 select sshd >> 3068 6655 6655 68 3 0x80 select sasyncd >> 6655 1 6655 0 3 0x80 select sasyncd >> 11118 4076 4076 68 3 0x80 select isakmpd >> 4076 1 4076 0 3 0x80 netio isakmpd >> 16603 1 16603 0 3 0x80 poll ntpd >> 9965 14530 9965 83 3 0x80 poll ntpd >> 14530 1 14530 83 3 0x80 poll ntpd >> 28104 8325 8325 70 3 0x80 select named >> 8325 1 8325 0 3 0x80 netio named >> 5060 11080 11080 74 3 0x80 bpf pflogd >> 11080 1 11080 0 3 0x80 netio pflogd >> 27911 10551 10551 73 3 0x80 poll syslogd >> 10551 1 10551 0 3 0x80 netio syslogd >> 16 0 0 0 3 0x100200 aiodoned aiodoned >> 15 0 0 0 3 0x100200 syncer update >> 14 0 0 0 3 0x100200 cleaner cleaner >> 13 0 0 0 3 0x100200 reaper reaper >> 12 0 0 0 3 0x100200 pgdaemon pagedaemon >> 11 0 0 0 3 0x100200 bored crypto >> 10 0 0 0 3 0x100200 pftm pfpurge >> 9 0 0 0 3 0x100200 usbtsk usbtask >> 8 0 0 0 3 0x100200 usbatsk usbatsk >> 7 0 0 0 3 0x100200 acpi0 acpi0 >> 6 0 0 0 7 0x40100200 idle3 >> 5 0 0 0 3 0x40100200 idle2 >> * 4 0 0 0 7 0x40100200 idle1 >> 3 0 0 0 7 0x100200 syswq >> 2 0 0 0 7 0x40100200 idle0 >> 1 0 1 0 3 0x80 wait init >> 0 -1 0 0 3 0x200 scheduler swapper >> >> ddb{1}> machine ddbcpu 2 >> Stopped at Debugger+0x5: leave >> RUN AT LEAST 'trace' AND 'ps' AND INCLUDE OUTPUT WHEN REPORTING THIS PANIC! >> IF RUNNING SMP, USE 'mach ddbcpu <#>' AND 'trace' ON OTHER PROCESSORS, TOO. >> DO NOT EVEN BOTHER REPORTING THIS WITHOUT INCLUDING THAT INFORMATION! >> >> ddb{2}> trace >> Debugger() at Debugger+0x5 >> panic() at panic+0xe4 >> msi_delroute() at msi_delroute+0x54 >> intr_disestablish() at intr_disestablish+0xe9 >> em_detach() at em_detach+0x26 >> config_detach() at config_detach+0x143 >> config_detach_children() at config_detach_children+0x3e >> pci_detach_devices() at pci_detach_devices+0x15 >> ppb_hotplug_remove() at ppb_hotplug_remove+0x26 >> workq_thread() at workq_thread+0x33 >> end trace frame: 0x0, count: -10 >> >> ddb{2}> machine ddbcpu 3 >> Stopped at Debugger+0x5: leave >> RUN AT LEAST 'trace' AND 'ps' AND INCLUDE OUTPUT WHEN REPORTING THIS PANIC! >> IF RUNNING SMP, USE 'mach ddbcpu <#>' AND 'trace' ON OTHER PROCESSORS, TOO. >> DO NOT EVEN BOTHER REPORTING THIS WITHOUT INCLUDING THAT INFORMATION! >> >> ddb{3}> trace >> Debugger() at Debugger+0x5 >> x86_ipi_handler() at x86_ipi_handler+0x64 >> Xresume_lapic_ipi() at Xresume_lapic_ipi+0x1b >> --- interrupt --- >> Bad frame pointer: 0xffff800020ecaf10 >> end trace frame: 0xffff800020ecaf10, count: -3 >> cpu_idle_cycle+0x13: >> >> DMESG >> >> OpenBSD 5.1 (GENERIC.MP) #207: Sun Feb 12 09:42:14 MST 2012 >> [email protected]:/usr/src/sys/arch/amd64/compile/GENERIC.MP >> real mem = 2118471680 (2020MB) >> avail mem = 2047971328 (1953MB) >> mainbus0 at root >> bios0 at mainbus0: SMBIOS rev. 2.7 @ 0xeb4c0 (54 entries) >> bios0: vendor American Megatrends Inc. version "2.00" date 05/08/2012 >> bios0: Supermicro X9SCI/X9SCA >> acpi0 at bios0: rev 2 >> acpi0: sleep states S0 S1 S4 S5 >> acpi0: tables DSDT FACP APIC FPDT MCFG PRAD HPET SSDT SPMI SSDT SSDT >> SPCR EINJ ERST HEST BERT >> acpi0: wakeup devices PS2K(S4) PS2M(S4) UAR1(S4) UAR2(S4) P0P1(S4) >> USB1(S4) USB2(S4) USB3(S4) USB4(S4) USB5(S4) USB6(S4) USB7(S4) PXSX(S4) >> RP01(S4) PXSX(S4) RP02(S4) PXSX(S4) RP03(S4) PXSX(S4) RP04(S4) PXSX(S4) >> RP05(S4) PXSX(S4) RP06(S4) PXSX(S4) RP07(S4) PXSX(S4) RP08(S4) PEGP(S4) >> PEG0(S4) PEG1(S4) PEG2(S4) PEG3(S4) GLAN(S4) EHC1(S4) EHC2(S4) HDEF(S4) >> PWRB(S4) >> acpitimer0 at acpi0: 3579545 Hz, 24 bits >> acpimadt0 at acpi0 addr 0xfee00000: PC-AT compat >> cpu0 at mainbus0: apid 0 (boot processor) >> cpu0: Intel(R) Xeon(R) CPU E31220 @ 3.10GHz, 3093.45 MHz >> cpu0: >> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,SBF,SSE3,PCLMUL,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,SSE4.1,SSE4.2,x2APIC,POPCNT,AES,XSAVE,AVX,NXE,LONG,LAHF >> cpu0: 256KB 64b/line 8-way L2 cache >> cpu0: apic clock running at 99MHz >> cpu1 at mainbus0: apid 2 (application processor) >> cpu1: Intel(R) Xeon(R) CPU E31220 @ 3.10GHz, 3092.98 MHz >> cpu1: >> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,SBF,SSE3,PCLMUL,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,SSE4.1,SSE4.2,x2APIC,POPCNT,AES,XSAVE,AVX,NXE,LONG,LAHF >> cpu1: 256KB 64b/line 8-way L2 cache >> cpu2 at mainbus0: apid 4 (application processor) >> cpu2: Intel(R) Xeon(R) CPU E31220 @ 3.10GHz, 3092.97 MHz >> cpu2: >> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,SBF,SSE3,PCLMUL,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,SSE4.1,SSE4.2,x2APIC,POPCNT,AES,XSAVE,AVX,NXE,LONG,LAHF >> cpu2: 256KB 64b/line 8-way L2 cache >> cpu3 at mainbus0: apid 6 (application processor) >> cpu3: Intel(R) Xeon(R) CPU E31220 @ 3.10GHz, 3092.98 MHz >> cpu3: >> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,SBF,SSE3,PCLMUL,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,SSE4.1,SSE4.2,x2APIC,POPCNT,AES,XSAVE,AVX,NXE,LONG,LAHF >> cpu3: 256KB 64b/line 8-way L2 cache >> ioapic0 at mainbus0: apid 2 pa 0xfec00000, version 20, 24 pins >> acpimcfg0 at acpi0 addr 0xf8000000, bus 0-63 >> acpihpet0 at acpi0: 14318179 Hz >> acpiprt0 at acpi0: bus 0 (PCI0) >> acpiprt1 at acpi0: bus 6 (P0P1) >> acpiprt2 at acpi0: bus 1 (RP01) >> acpiprt3 at acpi0: bus -1 (RP02) >> acpiprt4 at acpi0: bus -1 (RP03) >> acpiprt5 at acpi0: bus -1 (RP04) >> acpiprt6 at acpi0: bus 2 (RP05) >> acpiprt7 at acpi0: bus 3 (RP06) >> acpiprt8 at acpi0: bus 4 (RP07) >> acpiprt9 at acpi0: bus 5 (RP08) >> acpiprt10 at acpi0: bus -1 (PEG0) >> acpiprt11 at acpi0: bus -1 (PEG1) >> acpiprt12 at acpi0: bus -1 (PEG2) >> acpiprt13 at acpi0: bus -1 (PEG3) >> acpiec0 at acpi0: Failed to read resource settings >> acpicpu0 at acpi0: C3, C1, PSS >> acpicpu1 at acpi0: C3, C1, PSS >> acpicpu2 at acpi0: C3, C1, PSS >> acpicpu3 at acpi0: C3, C1, PSS >> acpipwrres0 at acpi0: FN00 >> acpipwrres1 at acpi0: FN01 >> acpipwrres2 at acpi0: FN02 >> acpipwrres3 at acpi0: FN03 >> acpipwrres4 at acpi0: FN04 >> acpitz0 at acpi0: critical temperature is 95 degC >> acpitz1 at acpi0: critical temperature is 95 degC >> acpibat0 at acpi0: BAT0 not present >> acpibat1 at acpi0: BAT1 not present >> acpibat2 at acpi0: BAT2 not present >> acpibtn0 at acpi0: PWRB >> acpibtn1 at acpi0: LID0 >> acpivideo0 at acpi0: GFX0 >> acpivout0 at acpivideo0: DD02 >> ipmi at mainbus0 not configured >> cpu0: Enhanced SpeedStep 3092 MHz: speeds: 3101, 3100, 3000, 2900, 2800, >> 2700, 2600, 2500, 2300, 2200, 2100, 2000, 1900, 1800, 1700, 1600 MHz >> pci0 at mainbus0 bus 0 >> pchb0 at pci0 dev 0 function 0 "Intel Xeon E3-1200 Host" rev 0x09 >> "Intel 6 Series MEI" rev 0x04 at pci0 dev 22 function 0 not configured >> vendor "Intel", unknown product 0x1c3b (class communications subclass >> miscellaneous, rev 0x04) at pci0 dev 22 function 1 not configured >> ehci0 at pci0 dev 26 function 0 "Intel 6 Series USB" rev 0x05: apic 2 int 16 >> usb0 at ehci0: USB revision 2.0 >> uhub0 at usb0 "Intel EHCI root hub" rev 2.00/1.00 addr 1 >> ppb0 at pci0 dev 28 function 0 "Intel 6 Series PCIE" rev 0xb5: msi >> pci1 at ppb0 bus 1 >> ppb1 at pci0 dev 28 function 4 "Intel 6 Series PCIE" rev 0xb5: msi >> pci2 at ppb1 bus 2 >> em0 at pci2 dev 0 function 0 "Intel PRO/1000 MT (82574L)" rev 0x00: msi, >> address 00:25:90:75:91:c0 >> ppb2 at pci0 dev 28 function 5 "Intel 6 Series PCIE" rev 0xb5: msi >> pci3 at ppb2 bus 3 >> em1 at pci3 dev 0 function 0 "Intel PRO/1000 MT (82574L)" rev 0x00: msi, >> address 00:25:90:75:91:c1 >> ppb3 at pci0 dev 28 function 6 "Intel 6 Series PCIE" rev 0xb5: msi >> pci4 at ppb3 bus 4 >> em2 at pci4 dev 0 function 0 "Intel PRO/1000 MT (82574L)" rev 0x00: msi, >> address 00:25:90:75:91:c2 >> ppb4 at pci0 dev 28 function 7 "Intel 6 Series PCIE" rev 0xb5: msi >> pci5 at ppb4 bus 5 >> em3 at pci5 dev 0 function 0 "Intel PRO/1000 MT (82574L)" rev 0x00: msi, >> address 00:25:90:75:91:c3 >> ehci1 at pci0 dev 29 function 0 "Intel 6 Series USB" rev 0x05: apic 2 int 23 >> usb1 at ehci1: USB revision 2.0 >> uhub1 at usb1 "Intel EHCI root hub" rev 2.00/1.00 addr 1 >> ppb5 at pci0 dev 30 function 0 "Intel 82801BA Hub-to-PCI" rev 0xa5 >> pci6 at ppb5 bus 6 >> vga1 at pci6 dev 3 function 0 "Matrox MGA G200eW" rev 0x0a >> wsdisplay0 at vga1 mux 1: console (80x25, vt100 emulation) >> wsdisplay0: screen 1-5 added (80x25, vt100 emulation) >> pcib0 at pci0 dev 31 function 0 "Intel C204 LPC" rev 0x05 >> ahci0 at pci0 dev 31 function 2 "Intel 6 Series AHCI" rev 0x05: msi, >> AHCI 1.3 >> scsibus0 at ahci0: 32 targets >> sd0 at scsibus0 targ 0 lun 0: <ATA, INTEL SSDSA2CT04, 4PC1> SCSI3 >> 0/direct fixed naa.5001517972e60be6 >> sd0: 38166MB, 512 bytes/sector, 78165360 sectors, thin >> ichiic0 at pci0 dev 31 function 3 "Intel 6 Series SMBus" rev 0x05: apic >> 2 int 18 >> iic0 at ichiic0 >> sdtemp0 at iic0 addr 0x18: stts2002 >> sdtemp1 at iic0 addr 0x1a: stts2002 >> spdmem0 at iic0 addr 0x50: 1GB DDR3 SDRAM ECC PC3-10600 with thermal sensor >> spdmem1 at iic0 addr 0x52: 1GB DDR3 SDRAM ECC PC3-10600 with thermal sensor >> isa0 at pcib0 >> isadma0 at isa0 >> com0 at isa0 port 0x3f8/8 irq 4: ns16550a, 16 byte fifo >> com0: console >> com1 at isa0 port 0x2f8/8 irq 3: ns16550a, 16 byte fifo >> pckbc0 at isa0 port 0x60/5 >> pckbd0 at pckbc0 (kbd slot) >> pckbc0: using irq 1 for kbd slot >> wskbd0 at pckbd0: console keyboard, using wsdisplay0 >> pcppi0 at isa0 port 0x61 >> spkr0 at pcppi0 >> wbsio0 at isa0 port 0x2e/2: NCT6776F rev 0x33 >> lm1 at wbsio0 port 0xa30/8: NCT6776F >> mtrr: Pentium Pro MTRR support >> uhub2 at uhub0 port 1 "Intel Rate Matching Hub" rev 2.00/0.00 addr 2 >> uhidev0 at uhub2 port 2 configuration 1 interface 0 "Winbond Electronics >> Corp Hermon USB hidmouse Device" rev 1.10/0.01 addr 3 >> uhidev0: iclass 3/1 >> ums0 at uhidev0: 3 buttons, Z dir >> wsmouse0 at ums0 mux 0 >> uhidev1 at uhub2 port 2 configuration 1 interface 1 "Winbond Electronics >> Corp Hermon USB hidmouse Device" rev 1.10/0.01 addr 3 >> uhidev1: iclass 3/1 >> ukbd0 at uhidev1: 8 modifier keys, 6 key codes >> wskbd1 at ukbd0 mux 1 >> wskbd1: connecting to wsdisplay0 >> uhub3 at uhub1 port 1 "Intel Rate Matching Hub" rev 2.00/0.00 addr 2 >> vscsi0 at root >> scsibus1 at vscsi0: 256 targets >> softraid0 at root >> scsibus2 at softraid0: 256 targets >> root on sd0a (124c86b6eb046834.a) swap on sd0b dump on sd0b >> >> Thanks >> Jim
