Re: Random system freeze.

2019-05-28 Thread Stuart Henderson
On 2019-05-28, Paco Esteban  wrote:
> Hi Stuart,
>
> On Tue, 28 May 2019, Stuart Henderson wrote:
>
>> Some things to try:
>> 
>> Does it seem to be in ddb? Try typing "call cpu_reset" blindly and see
>> if it reboots.
>
> I'll take a look at the manpages to see how that works. Never used the
> kerned debugger.

This is just a command which is likely to trigger a reboot (on amd64)
without getting into other problems that might hang. Basically to
identify whether it's in ddb without having changed the screen, or
whether it's hard locked. (There's some new non-arch-dependent command
to do this but I forgot what it's called and it didn't get added to the
ddb manual).


>> Does it start responding again if you wait?
>
> No, at least in a "short time period" (5 minutes more or less). I'll try
> to wait longer next time to test this.

I'd give it a little bit more than this, though probably doesn't need
much more. I've had systems recover from hangs after 5-10ish minutes
(I don't know if it's likely to be similar or completely different to
what you're seeing, so just throwing out a few things to try to get
more information and possibly help..).

>> What does "sysctl kern.timecounter.hardware" say? If it's tsc, try one
>> of the other names shown in "sysctl kern.timecounter.choice", probably
>> acpihpet0 if available.
>> 
>> Is it any better with the intel driver rathef than modesetting? Try this
>> in xorg.conf:
>> 
>> Section "Device"
>>Identifier  "Intel Graphics"
>>Driver  "intel"
>> EndSection
>
> I'll try them all one change at a time and try to make a table
> (work/crash) for it.
>
> It can take some time as the problem manifests randomly.
>
> Thanks for the suggestions.
>





Re: Random system freeze.

2019-05-28 Thread Jesper Wallin
On Tue, May 28, 2019 at 08:10:09PM +1000, Jonathan Gray wrote:
> On Tue, May 28, 2019 at 09:25:52AM -, Stuart Henderson wrote:
> > 
> > Does it seem to be in ddb? Try typing "call cpu_reset" blindly and see
> > if it reboots.

Hi, I'm having the same issue here, on a X1 Carbon (3rd gen)

No luck with "call cpu_reset", I might have done it wrong though, as
english keyboard isn't native to me and I assume that's what ddb use?

> > What does "sysctl kern.timecounter.hardware" say? If it's tsc, try one
> > of the other names shown in "sysctl kern.timecounter.choice", probably
> > acpihpet0 if available.

Had two freezes today, one using tsc and one using acpihpet0.


> All the reports I have seen have been from skylake or kabylake.
> Have never encountered it with ivy bridge or broadwell here.

I'm using a broadwell here (i7-5500U) with the intel drivers for Xorg.

Snapshots are from today and I've had these freezes for the last week or
so.  Doubt it's of importance, but I applied the latest BIOS update to
this machine yesterday and I've had these freezes since before that.



Re: Random system freeze.

2019-05-28 Thread Paco Esteban
Hi Stuart,

On Tue, 28 May 2019, Stuart Henderson wrote:

> Some things to try:
> 
> Does it seem to be in ddb? Try typing "call cpu_reset" blindly and see
> if it reboots.

I'll take a look at the manpages to see how that works. Never used the
kerned debugger.

> Does it start responding again if you wait?

No, at least in a "short time period" (5 minutes more or less). I'll try
to wait longer next time to test this.

> What does "sysctl kern.timecounter.hardware" say? If it's tsc, try one
> of the other names shown in "sysctl kern.timecounter.choice", probably
> acpihpet0 if available.
> 
> Is it any better with the intel driver rathef than modesetting? Try this
> in xorg.conf:
> 
> Section "Device"
>Identifier  "Intel Graphics"
>Driver  "intel"
> EndSection

I'll try them all one change at a time and try to make a table
(work/crash) for it.

It can take some time as the problem manifests randomly.

Thanks for the suggestions.

-- 
Paco Esteban.
https://onna.be/gpgkey.asc
9A6B 6083 AD9E FDC2 0EAF  5CB3 5818 130B 8A6D BC03



Re: Random system freeze.

2019-05-28 Thread Jonathan Gray
On Tue, May 28, 2019 at 09:25:52AM -, Stuart Henderson wrote:
> On 2019-05-23, Paco Esteban  wrote:
> > Hi misc@,
> >
> > I've been having some system freezes lately, as others using intel
> > graphics.
> >
> > Sometimes it does not hit in days but sometimes the system hangs 2 or 3
> > times a day.
> >
> > I was wondering if there's any iformation I can supply to devs that
> > could be useful (besides dmesg ...).
> 
> Some things to try:
> 
> Does it seem to be in ddb? Try typing "call cpu_reset" blindly and see
> if it reboots.
> 
> Does it start responding again if you wait?
> 
> What does "sysctl kern.timecounter.hardware" say? If it's tsc, try one
> of the other names shown in "sysctl kern.timecounter.choice", probably
> acpihpet0 if available.
> 
> Is it any better with the intel driver rathef than modesetting? Try this
> in xorg.conf:
> 
> Section "Device"
>Identifier  "Intel Graphics"
>Driver  "intel"
> EndSection
> 

All the reports I have seen have been from skylake or kabylake.
Have never encountered it with ivy bridge or broadwell here.

jcs@ mentioned off list:

enable_dc enable_fbc enable_psr enable_ips 0 lasts longer but locked up
after a few days.

Still locks up with no i915 firmware loaded.

Not reachable over network on lockup.

Occurs with intel xorg driver as well as modesetting.



Re: Random system freeze.

2019-05-28 Thread Stuart Henderson
On 2019-05-23, Paco Esteban  wrote:
> Hi misc@,
>
> I've been having some system freezes lately, as others using intel
> graphics.
>
> Sometimes it does not hit in days but sometimes the system hangs 2 or 3
> times a day.
>
> I was wondering if there's any iformation I can supply to devs that
> could be useful (besides dmesg ...).

Some things to try:

Does it seem to be in ddb? Try typing "call cpu_reset" blindly and see
if it reboots.

Does it start responding again if you wait?

What does "sysctl kern.timecounter.hardware" say? If it's tsc, try one
of the other names shown in "sysctl kern.timecounter.choice", probably
acpihpet0 if available.

Is it any better with the intel driver rathef than modesetting? Try this
in xorg.conf:

Section "Device"
   Identifier  "Intel Graphics"
   Driver  "intel"
EndSection





Re: Random system freeze.

2019-05-27 Thread Marco Nuessgen
On Mon, May 27, 2019 at 03:16:26PM +0200, Paco Esteban wrote:
[...]
> Later Karel Gardas suggested my RAM could be failing. I did a full test
> with memtest86 which returned no errors. If somebody knows a better method
> to test that (or if this tool is good enough to rule bad ram out),
> please tell me.
[...]

I would too sucpect: it's a faulty RAM module.

Give "stress" a try:
https://people.seas.harvard.edu/~apw/stress/

Is this an IBM server? Test it with the DSA tools (Dynamis System
Analysis).

Marco.



Re: Random system freeze.

2019-05-27 Thread Paco Esteban
Hi Gregory,

On Fri, 24 May 2019, Gregory Edigarov wrote:

> Hi Paco,
> 
> could you please check if you can login over  network when the system
> freeze?
> if so - please do a backtrace of the X server.
> i.e.:
> 
> su -
> gdb /usr/X11R6/bin/X `pgrep  X`
> bt

Unfortunately I cannot login over ssh The system is non responsive when
this happens (no icmp response, nothing ...).

I was told to use sendbug to report this (and I did). Although I'm
afraid the info I can provide may be useless.

Later Karel Gardas suggested my RAM could be failing. I did a full test
with memtest86 which returned no errors. If somebody knows a better method
to test that (or if this tool is good enough to rule bad ram out),
please tell me.

Cheers,

-- 
Paco Esteban.
https://onna.be/gpgkey.asc
9A6B 6083 AD9E FDC2 0EAF  5CB3 5818 130B 8A6D BC03



Re: Random system freeze.

2019-05-24 Thread Gregory Edigarov

Hi Paco,

could you please check if you can login over  network when the system 
freeze?

if so - please do a backtrace of the X server.
i.e.:

su -
gdb /usr/X11R6/bin/X `pgrep  X`
bt

just curious, if you'll my condition also.
that may help developers in problem identification.

thanks.

On 23.05.19 18:35, Paco Esteban wrote:

Hi misc@,

I've been having some system freezes lately, as others using intel
graphics.

Sometimes it does not hit in days but sometimes the system hangs 2 or 3
times a day.

I was wondering if there's any iformation I can supply to devs that
could be useful (besides dmesg ...).

Cheers,
Paco.

OpenBSD 6.5-current (GENERIC.MP) #37: Tue May 21 19:41:49 MDT 2019
 dera...@amd64.openbsd.org:/usr/src/sys/arch/amd64/compile/GENERIC.MP
real mem = 16567697408 (15800MB)
avail mem = 16055463936 (15311MB)
mpath0 at root
scsibus0 at mpath0: 256 targets
mainbus0 at root
bios0 at mainbus0: SMBIOS rev. 2.8 @ 0x67493000 (88 entries)
bios0: vendor American Megatrends Inc. version "F4" date 09/04/2015
bios0: Gigabyte Technology Co., Ltd. Z170N-WIFI-CF
acpi0 at bios0: rev 2
acpi0: sleep states S0 S3 S4 S5
acpi0: tables DSDT FACP APIC FPDT FIDT MCFG HPET SSDT SSDT UEFI LPIT SSDT SSDT 
SSDT DBGP DBG2 SSDT SSDT BGRT DMAR ASF!
acpi0: wakeup devices PEGP(S4) PEG0(S4) PEGP(S4) PEG1(S4) PEGP(S4) PEG2(S4) 
PS2K(S3) PS2M(S3) PXSX(S4) RP09(S4) PXSX(S4) RP10(S4) PXSX(S4) RP11(S4) 
PXSX(S4) RP12(S4) [...]
acpitimer0 at acpi0: 3579545 Hz, 24 bits
acpimadt0 at acpi0 addr 0xfee0: PC-AT compat
cpu0 at mainbus0: apid 0 (boot processor)
cpu0: Intel(R) Core(TM) i5-6500 CPU @ 3.20GHz, 3601.34 MHz, 06-5e-03
cpu0: 
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,3DNOWP,PERF,ITSC,FSGSBASE,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,MPX,RDSEED,ADX,SMAP,CLFLUSHOPT,PT,MD_CLEAR,TSXFA,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,XSAVEC,XGETBV1,XSAVES,MELTDOWN
cpu0: 256KB 64b/line 8-way L2 cache
cpu0: smt 0, core 0, package 0
mtrr: Pentium Pro MTRR support, 10 var ranges, 88 fixed ranges
cpu0: apic clock running at 23MHz
cpu0: mwait min=64, max=64, C-substates=0.2.1.2.4.1, IBE
cpu1 at mainbus0: apid 2 (application processor)
cpu1: Intel(R) Core(TM) i5-6500 CPU @ 3.20GHz, 3500.01 MHz, 06-5e-03
cpu1: 
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,3DNOWP,PERF,ITSC,FSGSBASE,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,MPX,RDSEED,ADX,SMAP,CLFLUSHOPT,PT,MD_CLEAR,TSXFA,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,XSAVEC,XGETBV1,XSAVES,MELTDOWN
cpu1: 256KB 64b/line 8-way L2 cache
cpu1: smt 0, core 1, package 0
cpu2 at mainbus0: apid 4 (application processor)
cpu2: Intel(R) Core(TM) i5-6500 CPU @ 3.20GHz, 3400.00 MHz, 06-5e-03
cpu2: 
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,3DNOWP,PERF,ITSC,FSGSBASE,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,MPX,RDSEED,ADX,SMAP,CLFLUSHOPT,PT,MD_CLEAR,TSXFA,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,XSAVEC,XGETBV1,XSAVES,MELTDOWN
cpu2: 256KB 64b/line 8-way L2 cache
cpu2: smt 0, core 2, package 0
cpu3 at mainbus0: apid 6 (application processor)
cpu3: Intel(R) Core(TM) i5-6500 CPU @ 3.20GHz, 3300.00 MHz, 06-5e-03
cpu3: 
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,3DNOWP,PERF,ITSC,FSGSBASE,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,MPX,RDSEED,ADX,SMAP,CLFLUSHOPT,PT,MD_CLEAR,TSXFA,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,XSAVEC,XGETBV1,XSAVES,MELTDOWN
cpu3: 256KB 64b/line 8-way L2 cache
cpu3: smt 0, core 3, package 0
ioapic0 at mainbus0: apid 2 pa 0xfec0, version 20, 120 pins
acpimcfg0 at acpi0
acpimcfg0: addr 0xe000, bus 0-255
acpihpet0 at acpi0: 2399 Hz
acpiprt0 at acpi0: bus 0 (PCI0)
acpiprt1 at acpi0: bus -1 (PEG0)
acpiprt2 at acpi0: bus -1 (PEG1)
acpiprt3 at acpi0: bus -1 (PEG2)
acpiprt4 at acpi0: bus 5 (RP09)
acpiprt5 at acpi0: bus -1 (RP10)
acpiprt6 at acpi0: bus -1 (RP11)
acpiprt7 at acpi0: bus -1 (RP12)
acpiprt8 at acpi0: bus 6 (RP13)
acpiprt9 at acpi0: bus 2 (RP01)
acpiprt10 at acpi0: bus -1 (RP02)
acpiprt11 at acpi0: bus -1 (RP03)
acpiprt12 at acpi0: bus 

Random system freeze.

2019-05-23 Thread Paco Esteban
Hi misc@,

I've been having some system freezes lately, as others using intel
graphics.

Sometimes it does not hit in days but sometimes the system hangs 2 or 3
times a day.

I was wondering if there's any iformation I can supply to devs that
could be useful (besides dmesg ...).

Cheers,
Paco.

OpenBSD 6.5-current (GENERIC.MP) #37: Tue May 21 19:41:49 MDT 2019
dera...@amd64.openbsd.org:/usr/src/sys/arch/amd64/compile/GENERIC.MP
real mem = 16567697408 (15800MB)
avail mem = 16055463936 (15311MB)
mpath0 at root
scsibus0 at mpath0: 256 targets
mainbus0 at root
bios0 at mainbus0: SMBIOS rev. 2.8 @ 0x67493000 (88 entries)
bios0: vendor American Megatrends Inc. version "F4" date 09/04/2015
bios0: Gigabyte Technology Co., Ltd. Z170N-WIFI-CF
acpi0 at bios0: rev 2
acpi0: sleep states S0 S3 S4 S5
acpi0: tables DSDT FACP APIC FPDT FIDT MCFG HPET SSDT SSDT UEFI LPIT SSDT SSDT 
SSDT DBGP DBG2 SSDT SSDT BGRT DMAR ASF!
acpi0: wakeup devices PEGP(S4) PEG0(S4) PEGP(S4) PEG1(S4) PEGP(S4) PEG2(S4) 
PS2K(S3) PS2M(S3) PXSX(S4) RP09(S4) PXSX(S4) RP10(S4) PXSX(S4) RP11(S4) 
PXSX(S4) RP12(S4) [...]
acpitimer0 at acpi0: 3579545 Hz, 24 bits
acpimadt0 at acpi0 addr 0xfee0: PC-AT compat
cpu0 at mainbus0: apid 0 (boot processor)
cpu0: Intel(R) Core(TM) i5-6500 CPU @ 3.20GHz, 3601.34 MHz, 06-5e-03
cpu0: 
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,3DNOWP,PERF,ITSC,FSGSBASE,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,MPX,RDSEED,ADX,SMAP,CLFLUSHOPT,PT,MD_CLEAR,TSXFA,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,XSAVEC,XGETBV1,XSAVES,MELTDOWN
cpu0: 256KB 64b/line 8-way L2 cache
cpu0: smt 0, core 0, package 0
mtrr: Pentium Pro MTRR support, 10 var ranges, 88 fixed ranges
cpu0: apic clock running at 23MHz
cpu0: mwait min=64, max=64, C-substates=0.2.1.2.4.1, IBE
cpu1 at mainbus0: apid 2 (application processor)
cpu1: Intel(R) Core(TM) i5-6500 CPU @ 3.20GHz, 3500.01 MHz, 06-5e-03
cpu1: 
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,3DNOWP,PERF,ITSC,FSGSBASE,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,MPX,RDSEED,ADX,SMAP,CLFLUSHOPT,PT,MD_CLEAR,TSXFA,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,XSAVEC,XGETBV1,XSAVES,MELTDOWN
cpu1: 256KB 64b/line 8-way L2 cache
cpu1: smt 0, core 1, package 0
cpu2 at mainbus0: apid 4 (application processor)
cpu2: Intel(R) Core(TM) i5-6500 CPU @ 3.20GHz, 3400.00 MHz, 06-5e-03
cpu2: 
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,3DNOWP,PERF,ITSC,FSGSBASE,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,MPX,RDSEED,ADX,SMAP,CLFLUSHOPT,PT,MD_CLEAR,TSXFA,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,XSAVEC,XGETBV1,XSAVES,MELTDOWN
cpu2: 256KB 64b/line 8-way L2 cache
cpu2: smt 0, core 2, package 0
cpu3 at mainbus0: apid 6 (application processor)
cpu3: Intel(R) Core(TM) i5-6500 CPU @ 3.20GHz, 3300.00 MHz, 06-5e-03
cpu3: 
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,3DNOWP,PERF,ITSC,FSGSBASE,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,MPX,RDSEED,ADX,SMAP,CLFLUSHOPT,PT,MD_CLEAR,TSXFA,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,XSAVEC,XGETBV1,XSAVES,MELTDOWN
cpu3: 256KB 64b/line 8-way L2 cache
cpu3: smt 0, core 3, package 0
ioapic0 at mainbus0: apid 2 pa 0xfec0, version 20, 120 pins
acpimcfg0 at acpi0
acpimcfg0: addr 0xe000, bus 0-255
acpihpet0 at acpi0: 2399 Hz
acpiprt0 at acpi0: bus 0 (PCI0)
acpiprt1 at acpi0: bus -1 (PEG0)
acpiprt2 at acpi0: bus -1 (PEG1)
acpiprt3 at acpi0: bus -1 (PEG2)
acpiprt4 at acpi0: bus 5 (RP09)
acpiprt5 at acpi0: bus -1 (RP10)
acpiprt6 at acpi0: bus -1 (RP11)
acpiprt7 at acpi0: bus -1 (RP12)
acpiprt8 at acpi0: bus 6 (RP13)
acpiprt9 at acpi0: bus 2 (RP01)
acpiprt10 at acpi0: bus -1 (RP02)
acpiprt11 at acpi0: bus -1 (RP03)
acpiprt12 at acpi0: bus -1 (RP04)
acpiprt13 at acpi0: bus 3 (RP05)
acpiprt14 at acpi0: bus 4 (RP06)
acpiprt15 at acpi0: bus -1 (RP07)
acpiprt16 at acpi0: bus -1 (RP08)
acpiprt17 at acpi0: bus 1 (RP17)
acpiprt18 at acpi0: bus -1 (RP18)
acpiprt19 at acpi0: bus -1 (RP19)
acpiprt20 at acpi0: bus -1 (RP20)
acpiprt21 at acpi0: bus -1 (RP14)
acpiprt22 at acpi0: