Re: High ACPI CPU load

2023-07-17 Thread Brian Conway
On Sat, Jul 15, 2023, at 5:38 PM, Julian Huhn wrote:
> On Sat, Jul 15, 2023 at 06:05:06PM +, Mike Larkin wrote:
>>On Sat, Jul 15, 2023 at 04:34:20PM +0200, Julian Huhn wrote:
>>> Since I got many DMARC rejection mails and therefore don't know how many
>>> people this mail reached at all, once again with less restrictive DMARC
>>> settings.
>>>
>>> On Sat, Jul 15, 2023 at 02:28:56PM +0200, Julian Huhn wrote:
>>> > Moin!
>>> >
>>> > A few weeks ago, I put a new system into operation, where I notice a
>>> > permanently high CPU load. With the help of top it appears that
>>> > permanently the process acpi0 is executed.
>>> >
>>> > Is this a bug?
>>> >
>>> > I'm happy to help with more logs, if you tell me what you need.
>>> >
>>> > --Huhn
>>> >
>>
>>This is a stuck GPE. This board in particular is a known issue; search
>>the lists.
>>
>>mbuhl@ suggested a few months back that I get one of these machines to fix
>>the issue, but when I started looking at it, the simplest fix was to just
>>install a new bios.  Since this is likely one of these super cheap 4 port
>>igc(4) aliexpress "firewall PCs", you may need to search a bit to find a
>>compatible bios since most of these don't have a real brand site associated
>>with them.
>>
>>FWIW, the machines with "techvision" bios (like yours) exhibit this issue.
>>Mine had techvision bios (and the same problem) before I flashed it to the
>>image described below.
>>
>>You need to find this bios:
>>
>>bios0: vendor American Megatrends International, LLC. version "JK4LV107" date 
>>04/17/2023
>
> I just found this Reddit Post [0], describing a related issue with this 
> kind of board. There's also a download link [1] in the comments for the 
> bios update. As soon as I found some time I will install the update. 
> Thanks!
>
>>That one works on my machine, with exactly the same config as yours. No
>>more ACPI GPE storm.
>>
>>I don't have the link anymore for where I found the BIOS image, but I
>>think it was on servethehome in one of the long threads about these
>>machines. You need to do some digging.
>>
>>While the root cause may be due to us lacking some driver for the device
>>owning that GPE, or our lack of activating GPEs based on attached
>>hardware, the 5-minute bios update fix was a good enough fix for me and
>>I moved on to other things.
>>
>>The other lesson I learned is that you get what you pay for; buying $100
>>PCs from aliexpress means you're just going to be paying for it somewhere
>>else. In this case, dealing with shoddy engineering and unsupported boards.
>>
>>-ml
>>
>>>
>
> [0] 
> https://www.reddit.com/r/PFSENSE/comments/14vv90w/topton_5105_n6005_owners_any_issues_running_on/
> [1] 
> https://pan.x86pi.cn/BIOS%E6%9B%B4%E6%96%B0/1.Intel%E8%BF%B7%E4%BD%A0%E4%B8%BB%E6%9C%BA%E7%B3%BB%E5%88%97BIOS/N5105%20V3-V5%20%E5%BE%AE%E7%A0%81%E6%9B%B4%E6%96%B023-04-18

I can confirm that the linked BIOS update resolves the stuck GPE on my board. I 
ended up using unetbootin to get the ISO in a state that my board was willing 
to boot and flash.

I appear to have lost the ability to redirect the BIOS via serial console with 
this update, but as noted, you get what you pay for.

Thanks all.

Brian



Re: High ACPI CPU load

2023-07-15 Thread Julian Huhn

On Sat, Jul 15, 2023 at 06:05:06PM +, Mike Larkin wrote:

On Sat, Jul 15, 2023 at 04:34:20PM +0200, Julian Huhn wrote:

Since I got many DMARC rejection mails and therefore don't know how many
people this mail reached at all, once again with less restrictive DMARC
settings.

On Sat, Jul 15, 2023 at 02:28:56PM +0200, Julian Huhn wrote:
> Moin!
>
> A few weeks ago, I put a new system into operation, where I notice a
> permanently high CPU load. With the help of top it appears that
> permanently the process acpi0 is executed.
>
> Is this a bug?
>
> I'm happy to help with more logs, if you tell me what you need.
>
> --Huhn
>


This is a stuck GPE. This board in particular is a known issue; search
the lists.

mbuhl@ suggested a few months back that I get one of these machines to fix
the issue, but when I started looking at it, the simplest fix was to just
install a new bios.  Since this is likely one of these super cheap 4 port
igc(4) aliexpress "firewall PCs", you may need to search a bit to find a
compatible bios since most of these don't have a real brand site associated
with them.

FWIW, the machines with "techvision" bios (like yours) exhibit this issue.
Mine had techvision bios (and the same problem) before I flashed it to the
image described below.

You need to find this bios:

bios0: vendor American Megatrends International, LLC. version "JK4LV107" date 
04/17/2023


I just found this Reddit Post [0], describing a related issue with this 
kind of board. There's also a download link [1] in the comments for the 
bios update. As soon as I found some time I will install the update. 
Thanks!



That one works on my machine, with exactly the same config as yours. No
more ACPI GPE storm.

I don't have the link anymore for where I found the BIOS image, but I
think it was on servethehome in one of the long threads about these
machines. You need to do some digging.

While the root cause may be due to us lacking some driver for the device
owning that GPE, or our lack of activating GPEs based on attached
hardware, the 5-minute bios update fix was a good enough fix for me and
I moved on to other things.

The other lesson I learned is that you get what you pay for; buying $100
PCs from aliexpress means you're just going to be paying for it somewhere
else. In this case, dealing with shoddy engineering and unsupported boards.

-ml


> # top -S
> load averages:  1.01,  0.99,  1.00blech02.trust.dtm.huhn.dev
> 14:08:31
> 85 processes: 81 idle, 4 on processor  up 3 days 16:04:10
> CPU0 states:  0.1% user,  0.0% nice, 16.3% sys,  0.5% spin, 75.6% intr,
> 7.5% idle
> CPU1 states:  0.1% user,  0.0% nice,  0.9% sys,  3.3% spin,  0.0% intr,
> 95.7% idle
> CPU2 states:  0.1% user,  0.0% nice,  0.9% sys,  3.3% spin,  0.0% intr,
> 95.7% idle
> CPU3 states:  0.1% user,  0.0% nice,  0.7% sys,  2.5% spin,  0.0% intr,
> 96.7% idle
> Memory: Real: 33M/10G act/tot Free: 21G Cache: 9303M Swap: 0K/32G
>
>  PID USERNAME PRI NICE  SIZE   RES STATE WAIT  TIMECPU
> COMMAND
> 57981 root  3400K 1976K onproc/0  -   832:27 15.48%
> acpi0
> 18343 root  2800K 1976K onproc/3  -85.2H  0.00%
> idle3
> 71885 root -2200K 1976K sleep/1   -84.3H  0.00%
> idle1
> 6761 root  2800K 1976K onproc/2  -84.3H  0.00% idle2
> 7152 root -2200K 1976K sleep/0   -69.4H  0.00% idle0
> 95844 root  1800K 1976K sleep/2   syncer0:48  0.00%
> update
> 92641 root  1000K 1976K sleep/1   bored 0:40  0.00%
> softnet
> 10729 root  1000K 1976K sleep/3   bored 0:31  0.00%
> sensors
> 31290 root  1000K 1976K sleep/2   bored 0:22  0.00%
> softnet
> 23268 _pflogd40  764K 1588K sleep/2   bpf   0:22  0.00%
> pflogd
> 7279 root  1000K 1976K sleep/1   bored 0:21  0.00% srdis
> 24604 jhuhn  20 1460K 3448K sleep/1   kqread0:14  0.00% sshd
> 9279 root -2200K 1976K sleep/0   bored 0:10  0.00%
> softclock
> 35785 root 105   200K 1976K sleep/2   pgzero0:10  0.00%
> zerothread
> 21023 root  100  476K  972K sleep/2   nanoslp   0:06  0.00%
> sensorsd
> 82628 root  1000K 1976K sleep/1   bored 0:05  0.00%
> systqmp
> 76212 root  1000K 1976K sleep/2   bored 0:05  0.00%
> softnet
> 52512 root  1000K 1976K sleep/1   bored 0:04  0.00%
> systq
>
> # dmesg
> OpenBSD 7.3 (GENERIC.MP) #1125: Sat Mar 25 10:36:29 MDT 2023
> dera...@amd64.openbsd.org:/usr/src/sys/arch/amd64/compile/GENERIC.MP
> real mem = 34180132864 (32596MB)
> avail mem = 33124827136 (31590MB)
> random: good seed from bootblocks
> mpath0 at root
> scsibus0 at mpath0: 256 targets
> mainbus0 at root
> bios0 at mainbus0: SMBIOS rev. 3.3 @ 0x78d77000 (116 entries)
> bios0: vendor Techvision, LLC. version "5.19" date 09/16/2022
> bios0: Techvision TVI7309X
> efi0 at bios0: UEFI 2.7
> efi0: American Megatrends rev 0x50013
> acpi0 at bios0: ACPI 

Re: High ACPI CPU load

2023-07-15 Thread Mike Larkin
On Sat, Jul 15, 2023 at 04:34:20PM +0200, Julian Huhn wrote:
> Since I got many DMARC rejection mails and therefore don't know how many
> people this mail reached at all, once again with less restrictive DMARC
> settings.
>
> On Sat, Jul 15, 2023 at 02:28:56PM +0200, Julian Huhn wrote:
> > Moin!
> >
> > A few weeks ago, I put a new system into operation, where I notice a
> > permanently high CPU load. With the help of top it appears that
> > permanently the process acpi0 is executed.
> >
> > Is this a bug?
> >
> > I'm happy to help with more logs, if you tell me what you need.
> >
> > --Huhn
> >

This is a stuck GPE. This board in particular is a known issue; search
the lists.

mbuhl@ suggested a few months back that I get one of these machines to fix
the issue, but when I started looking at it, the simplest fix was to just
install a new bios.  Since this is likely one of these super cheap 4 port
igc(4) aliexpress "firewall PCs", you may need to search a bit to find a
compatible bios since most of these don't have a real brand site associated
with them.

FWIW, the machines with "techvision" bios (like yours) exhibit this issue.
Mine had techvision bios (and the same problem) before I flashed it to the
image described below.

You need to find this bios:

bios0: vendor American Megatrends International, LLC. version "JK4LV107" date 
04/17/2023

That one works on my machine, with exactly the same config as yours. No
more ACPI GPE storm.

I don't have the link anymore for where I found the BIOS image, but I
think it was on servethehome in one of the long threads about these
machines. You need to do some digging.

While the root cause may be due to us lacking some driver for the device
owning that GPE, or our lack of activating GPEs based on attached
hardware, the 5-minute bios update fix was a good enough fix for me and
I moved on to other things.

The other lesson I learned is that you get what you pay for; buying $100
PCs from aliexpress means you're just going to be paying for it somewhere
else. In this case, dealing with shoddy engineering and unsupported boards.

-ml

> > # top -S
> > load averages:  1.01,  0.99,  1.00blech02.trust.dtm.huhn.dev
> > 14:08:31
> > 85 processes: 81 idle, 4 on processor  up 3 days 16:04:10
> > CPU0 states:  0.1% user,  0.0% nice, 16.3% sys,  0.5% spin, 75.6% intr,
> > 7.5% idle
> > CPU1 states:  0.1% user,  0.0% nice,  0.9% sys,  3.3% spin,  0.0% intr,
> > 95.7% idle
> > CPU2 states:  0.1% user,  0.0% nice,  0.9% sys,  3.3% spin,  0.0% intr,
> > 95.7% idle
> > CPU3 states:  0.1% user,  0.0% nice,  0.7% sys,  2.5% spin,  0.0% intr,
> > 96.7% idle
> > Memory: Real: 33M/10G act/tot Free: 21G Cache: 9303M Swap: 0K/32G
> >
> >  PID USERNAME PRI NICE  SIZE   RES STATE WAIT  TIMECPU
> > COMMAND
> > 57981 root  3400K 1976K onproc/0  -   832:27 15.48%
> > acpi0
> > 18343 root  2800K 1976K onproc/3  -85.2H  0.00%
> > idle3
> > 71885 root -2200K 1976K sleep/1   -84.3H  0.00%
> > idle1
> > 6761 root  2800K 1976K onproc/2  -84.3H  0.00% idle2
> > 7152 root -2200K 1976K sleep/0   -69.4H  0.00% idle0
> > 95844 root  1800K 1976K sleep/2   syncer0:48  0.00%
> > update
> > 92641 root  1000K 1976K sleep/1   bored 0:40  0.00%
> > softnet
> > 10729 root  1000K 1976K sleep/3   bored 0:31  0.00%
> > sensors
> > 31290 root  1000K 1976K sleep/2   bored 0:22  0.00%
> > softnet
> > 23268 _pflogd40  764K 1588K sleep/2   bpf   0:22  0.00%
> > pflogd
> > 7279 root  1000K 1976K sleep/1   bored 0:21  0.00% srdis
> > 24604 jhuhn  20 1460K 3448K sleep/1   kqread0:14  0.00% sshd
> > 9279 root -2200K 1976K sleep/0   bored 0:10  0.00%
> > softclock
> > 35785 root 105   200K 1976K sleep/2   pgzero0:10  0.00%
> > zerothread
> > 21023 root  100  476K  972K sleep/2   nanoslp   0:06  0.00%
> > sensorsd
> > 82628 root  1000K 1976K sleep/1   bored 0:05  0.00%
> > systqmp
> > 76212 root  1000K 1976K sleep/2   bored 0:05  0.00%
> > softnet
> > 52512 root  1000K 1976K sleep/1   bored 0:04  0.00%
> > systq
> >
> > # dmesg
> > OpenBSD 7.3 (GENERIC.MP) #1125: Sat Mar 25 10:36:29 MDT 2023
> > dera...@amd64.openbsd.org:/usr/src/sys/arch/amd64/compile/GENERIC.MP
> > real mem = 34180132864 (32596MB)
> > avail mem = 33124827136 (31590MB)
> > random: good seed from bootblocks
> > mpath0 at root
> > scsibus0 at mpath0: 256 targets
> > mainbus0 at root
> > bios0 at mainbus0: SMBIOS rev. 3.3 @ 0x78d77000 (116 entries)
> > bios0: vendor Techvision, LLC. version "5.19" date 09/16/2022
> > bios0: Techvision TVI7309X
> > efi0 at bios0: UEFI 2.7
> > efi0: American Megatrends rev 0x50013
> > acpi0 at bios0: ACPI 6.2
> > acpi0: sleep states S0 S3 S5
> > acpi0: tables DSDT FACP MCFG FIDT SSDT SSDT SSDT HPET APIC PRAM SSDT
> > SSDT NHLT LPIT SSDT 

Re: High ACPI CPU load

2023-07-15 Thread Julian Huhn
Since I got many DMARC rejection mails and therefore don't know how many 
people this mail reached at all, once again with less restrictive DMARC 
settings.


On Sat, Jul 15, 2023 at 02:28:56PM +0200, Julian Huhn wrote:

Moin!

A few weeks ago, I put a new system into operation, where I notice a 
permanently high CPU load. With the help of top it appears that 
permanently the process acpi0 is executed.


Is this a bug?

I'm happy to help with more logs, if you tell me what you need.

--Huhn

# top -S
load averages:  1.01,  0.99,  1.00blech02.trust.dtm.huhn.dev 
14:08:31

85 processes: 81 idle, 4 on processor  up 3 days 16:04:10
CPU0 states:  0.1% user,  0.0% nice, 16.3% sys,  0.5% spin, 75.6% 
intr,  7.5% idle
CPU1 states:  0.1% user,  0.0% nice,  0.9% sys,  3.3% spin,  0.0% 
intr, 95.7% idle
CPU2 states:  0.1% user,  0.0% nice,  0.9% sys,  3.3% spin,  0.0% 
intr, 95.7% idle
CPU3 states:  0.1% user,  0.0% nice,  0.7% sys,  2.5% spin,  0.0% 
intr, 96.7% idle

Memory: Real: 33M/10G act/tot Free: 21G Cache: 9303M Swap: 0K/32G

 PID USERNAME PRI NICE  SIZE   RES STATE WAIT  TIMECPU   
COMMAND
57981 root  3400K 1976K onproc/0  -   832:27 15.48% 
acpi0
18343 root  2800K 1976K onproc/3  -85.2H  0.00% 
idle3
71885 root -2200K 1976K sleep/1   -84.3H  0.00% 
idle1

6761 root  2800K 1976K onproc/2  -84.3H  0.00% idle2
7152 root -2200K 1976K sleep/0   -69.4H  0.00% idle0
95844 root  1800K 1976K sleep/2   syncer0:48  0.00% 
update
92641 root  1000K 1976K sleep/1   bored 0:40  0.00% 
softnet
10729 root  1000K 1976K sleep/3   bored 0:31  0.00% 
sensors
31290 root  1000K 1976K sleep/2   bored 0:22  0.00% 
softnet
23268 _pflogd40  764K 1588K sleep/2   bpf   0:22  0.00% 
pflogd

7279 root  1000K 1976K sleep/1   bored 0:21  0.00% srdis
24604 jhuhn  20 1460K 3448K sleep/1   kqread0:14  0.00% sshd
9279 root -2200K 1976K sleep/0   bored 0:10  0.00% 
softclock
35785 root 105   200K 1976K sleep/2   pgzero0:10  0.00% 
zerothread
21023 root  100  476K  972K sleep/2   nanoslp   0:06  0.00% 
sensorsd
82628 root  1000K 1976K sleep/1   bored 0:05  0.00% 
systqmp
76212 root  1000K 1976K sleep/2   bored 0:05  0.00% 
softnet
52512 root  1000K 1976K sleep/1   bored 0:04  0.00% 
systq


# dmesg
OpenBSD 7.3 (GENERIC.MP) #1125: Sat Mar 25 10:36:29 MDT 2023
dera...@amd64.openbsd.org:/usr/src/sys/arch/amd64/compile/GENERIC.MP
real mem = 34180132864 (32596MB)
avail mem = 33124827136 (31590MB)
random: good seed from bootblocks
mpath0 at root
scsibus0 at mpath0: 256 targets
mainbus0 at root
bios0 at mainbus0: SMBIOS rev. 3.3 @ 0x78d77000 (116 entries)
bios0: vendor Techvision, LLC. version "5.19" date 09/16/2022
bios0: Techvision TVI7309X
efi0 at bios0: UEFI 2.7
efi0: American Megatrends rev 0x50013
acpi0 at bios0: ACPI 6.2
acpi0: sleep states S0 S3 S5
acpi0: tables DSDT FACP MCFG FIDT SSDT SSDT SSDT HPET APIC PRAM SSDT 
SSDT NHLT LPIT SSDT SSDT DBGP DBG2 SSDT DMAR SSDT SPCR TPM2 WSMT FPDT
acpi0: wakeup devices PEGP(S3) PEGP(S3) PEGP(S3) PEGP(S3) PS2K(S3) 
PS2M(S3) RP01(S3) PXSX(S3) RP02(S3) PXSX(S3) RP03(S3) PXSX(S3) 
RP04(S3) PXSX(S3) RP05(S3) PXSX(S3) [...]

acpitimer0 at acpi0: 3579545 Hz, 24 bits
acpimcfg0 at acpi0
acpimcfg0: addr 0xc000, bus 0-255
acpihpet0 at acpi0: 1920 Hz
acpimadt0 at acpi0 addr 0xfee0: PC-AT compat
cpu0 at mainbus0: apid 0 (boot processor)
cpu0: Intel(R) Celeron(R) N5105 @ 2.00GHz, 2893.74 MHz, 06-9c-00
cpu0: 
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,EST,TM2,SSSE3,SDBG,CX16,xTPR,PDCM,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,RDRAND,NXE,RDTSCP,LONG,LAHF,3DNOWP,PERF,ITSC,FSGSBASE,TSC_ADJUST,SMEP,ERMS,RDSEED,SMAP,CLFLUSHOPT,CLWB,PT,SHA,UMIP,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,XSAVEC,XGETBV1,XSAVES
cpu0: 32KB 64b/line 8-way D-cache, 32KB 64b/line 8-way I-cache, 1MB 
64b/line 12-way L2 cache, 4MB 64b/line 16-way L3 cache

cpu0: smt 0, core 0, package 0
mtrr: Pentium Pro MTRR support, 10 var ranges, 88 fixed ranges
cpu0: apic clock running at 38MHz
cpu0: mwait min=64, max=64, C-substates=0.2.0.2.2.1.1.1, IBE
cpu1 at mainbus0: apid 2 (application processor)
cpu1: Intel(R) Celeron(R) N5105 @ 2.00GHz, 2893.74 MHz, 06-9c-00
cpu1: 
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,EST,TM2,SSSE3,SDBG,CX16,xTPR,PDCM,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,RDRAND,NXE,RDTSCP,LONG,LAHF,3DNOWP,PERF,ITSC,FSGSBASE,TSC_ADJUST,SMEP,ERMS,RDSEED,SMAP,CLFLUSHOPT,CLWB,PT,SHA,UMIP,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,XSAVEC,XGETBV1,XSAVES
cpu1: 32KB 64b/line