> Date: Thu, 9 Nov 2023 13:21:09 +0100
> From: Alexander Bluhm <[email protected]>
>
> Hi,
>
> During make build my arm64 machine with 32 CPUs crashed.
Next time this happens, please include "show malloc" output.
> ddb{24}> x/s version
> version: OpenBSD 7.4-current (GENERIC.MP) #16: Fri Nov 3 21:38:55 MDT
> 2023\012
> [email protected]:/usr/src/sys/arch/arm64/compile/GENERIC.MP\012
>
> ddb{24}> show panic
> cpu0: kernel diagnostic assertion "anon == NULL || anon->an_lock == NULL ||
> rw_write_held(anon->an_lock)" failed: file "/usr/src/sys/uvm/uvm_page.c",
> line 698
> cpu31: kernel diagnostic assertion "((flags & PGO_LOCKED) != 0 &&
> rw_lock_held(uobj->vmobjlock)) || (flags & PGO_LOCKED) == 0" failed: file
> "/usr/src/sys/uvm/uvm_vnode.c", line 953
> cpu30: pool_do_get: pted free list modified: page 0xffffff81baba8000; item
> addr 0xffffff81baba8298; offset 0x10=0x19ebd001
> cpu29: kernel diagnostic assertion "anon == NULL || anon->an_lock == NULL ||
> rw_write_held(anon->an_lock)" failed: file "/usr/src/sys/uvm/uvm_page.c",
> line 895
> cpu28: kernel diagnostic assertion "((flags & PGO_LOCKED) != 0 &&
> rw_lock_held(uobj->vmobjlock)) || (flags & PGO_LOCKED) == 0" failed: file
> "/usr/src/sys/uvm/uvm_vnode.c", line 953
> cpu27: uvm_fault failed: ffffff8000373488 esr 96000004 far f16be1bd7400ca3a
> cpu26: uvm_fault failed: ffffff8000373488 esr 96000004 far f16be1bd7400ca3a
> cpu25: pool_do_get: vp: page empty
> cpu24: pool_do_get: vp: page empty
> cpu23: uvm_fault failed: ffffff8000373488 esr 96000004 far f16be1bd7400ca3a
> cpu22: pool_do_get: pted: page empty
> *cpu21: malloc: out of space in kmem_map
> cpu20: pool_do_get: rwobjpl: page empty
> cpu19: pool_do_get: anonpl: page empty
> cpu18: uvm_fault failed: ffffff8000373488 esr 96000004 far f16be1bd7400ca3a
> cpu17: kernel diagnostic assertion "((flags & PGO_LOCKED) != 0 &&
> rw_lock_held(uobj->vmobjlock)) || (flags & PGO_LOCKED) == 0" failed: file
> "/usr/src/sys/uvm/uvm_vnode.c", line 953
> cpu16: kernel diagnostic assertion "((flags & PGO_LOCKED) != 0 &&
> rw_lock_held(uobj->vmobjlock)) || (flags & PGO_LOCKED) == 0" failed: file
> "/usr/src/sys/uvm/uvm_vnode.c", line 953
> cpu15: kernel diagnostic assertion "((flags & PGO_LOCKED) != 0 &&
> rw_lock_held(uobj->vmobjlock)) || (flags & PGO_LOCKED) == 0" failed: file
> "/usr/src/sys/uvm/uvm_vnode.c", line 953
> cpu14: pool_do_get: vp: page empty
> cpu13: pmap_pte_insert: have a pted, but missing a vp for 4afaaf2c3 va pmap
> 0xffffff81aa0685e8
> cpu12: pool_do_get: vp: page empty
> cpu10: attempt to access user address 0x30 from EL1
> cpu9: pool_do_put: pted: double pool_put: 0xffffff81afa52f30
> cpu8: pool_do_get: anonpl: page empty
> cpu7: kernel diagnostic assertion "((flags & PGO_LOCKED) != 0 &&
> rw_lock_held(uobj->vmobjlock)) || (flags & PGO_LOCKED) == 0" failed: file
> "/usr/src/sys/uvm/uvm_vnode.c", line 953
> cpu6: pool_do_get: anonpl: page empty
> cpu5: pool_do_get: vp: page empty
> cpu4: kernel diagnostic assertion "((flags & PGO_LOCKED) != 0 &&
> rw_lock_held(uobj->vmobjlock)) || (flags & PGO_LOCKED) == 0" failed: file
> "/usr/src/sys/uvm/uvm_vnode.c", line 953
> cpu3: kernel diagnostic assertion "((flags & PGO_LOCKED) != 0 &&
> rw_lock_held(uobj->vmobjlock)) || (flags & PGO_LOCKED) == 0" failed: file
> "/usr/src/sys/uvm/uvm_vnode.c", line 953
> cpu2: kernel diagnostic assertion "((flags & PGO_LOCKED) != 0 &&
> rw_lock_held(uobj->vmobjlock)) || (flags & PGO_LOCKED) == 0" failed: file
> "/usr/src/sys/uvm/uvm_vnode.c", line 953
> cpu1: kernel diagnostic assertion "anon == NULL || anon->an_lock == NULL ||
> rw_write_held(anon->an_lock)" failed: file "/usr/src/sys/uvm/uvm_page.c",
> line 698
>
> ddb{24}> show panic
> cpu0: kernel diagnostic assertion "anon == NULL || anon->an_lock == NULL ||
> rw_write_held(anon->an_lock)" failed: file "/usr/src/sys/uvm/uvm_page.c",
> line 698
> cpu31: kernel diagnostic assertion "((flags & PGO_LOCKED) != 0 &&
> rw_lock_held(uobj->vmobjlock)) || (flags & PGO_LOCKED) == 0" failed: file
> "/usr/src/sys/uvm/uvm_vnode.c", line 953
> cpu30: pool_do_get: pted free list modified: page 0xffffff81baba8000; item
> addr 0xffffff81baba8298; offset 0x10=0x19ebd001
> cpu29: kernel diagnostic assertion "anon == NULL || anon->an_lock == NULL ||
> rw_write_held(anon->an_lock)" failed: file "/usr/src/sys/uvm/uvm_page.c",
> line 895
> cpu28: kernel diagnostic assertion "((flags & PGO_LOCKED) != 0 &&
> rw_lock_held(uobj->vmobjlock)) || (flags & PGO_LOCKED) == 0" failed: file
> "/usr/src/sys/uvm/uvm_vnode.c", line 953
> cpu27: uvm_fault failed: ffffff8000373488 esr 96000004 far f16be1bd7400ca3a
> cpu26: uvm_fault failed: ffffff8000373488 esr 96000004 far f16be1bd7400ca3a
> cpu25: pool_do_get: vp: page empty
> cpu24: pool_do_get: vp: page empty
> cpu23: uvm_fault failed: ffffff8000373488 esr 96000004 far f16be1bd7400ca3a
> cpu22: pool_do_get: pted: page empty
> *cpu21: malloc: out of space in kmem_map
> cpu20: pool_do_get: rwobjpl: page empty
> cpu19: pool_do_get: anonpl: page empty
> cpu18: uvm_fault failed: ffffff8000373488 esr 96000004 far f16be1bd7400ca3a
> cpu17: kernel diagnostic assertion "((flags & PGO_LOCKED) != 0 &&
> rw_lock_held(uobj->vmobjlock)) || (flags & PGO_LOCKED) == 0" failed: file
> "/usr/src/sys/uvm/uvm_vnode.c", line 953
> cpu16: kernel diagnostic assertion "((flags & PGO_LOCKED) != 0 &&
> rw_lock_held(uobj->vmobjlock)) || (flags & PGO_LOCKED) == 0" failed: file
> "/usr/src/sys/uvm/uvm_vnode.c", line 953
> cpu15: kernel diagnostic assertion "((flags & PGO_LOCKED) != 0 &&
> rw_lock_held(uobj->vmobjlock)) || (flags & PGO_LOCKED) == 0" failed: file
> "/usr/src/sys/uvm/uvm_vnode.c", line 953
> cpu14: pool_do_get: vp: page empty
> cpu13: pmap_pte_insert: have a pted, but missing a vp for 4afaaf2c3 va pmap
> 0xffffff81aa0685e8
> cpu12: pool_do_get: vp: page empty
> cpu10: attempt to access user address 0x30 from EL1
> cpu9: pool_do_put: pted: double pool_put: 0xffffff81afa52f30
> cpu8: pool_do_get: anonpl: page empty
> cpu7: kernel diagnostic assertion "((flags & PGO_LOCKED) != 0 &&
> rw_lock_held(uobj->vmobjlock)) || (flags & PGO_LOCKED) == 0" failed: file
> "/usr/src/sys/uvm/uvm_vnode.c", line 953
> cpu6: pool_do_get: anonpl: page empty
> cpu5: pool_do_get: vp: page empty
> cpu4: kernel diagnostic assertion "((flags & PGO_LOCKED) != 0 &&
> rw_lock_held(uobj->vmobjlock)) || (flags & PGO_LOCKED) == 0" failed: file
> "/usr/src/sys/uvm/uvm_vnode.c", line 953
> cpu3: kernel diagnostic assertion "((flags & PGO_LOCKED) != 0 &&
> rw_lock_held(uobj->vmobjlock)) || (flags & PGO_LOCKED) == 0" failed: file
> "/usr/src/sys/uvm/uvm_vnode.c", line 953
> cpu2: kernel diagnostic assertion "((flags & PGO_LOCKED) != 0 &&
> rw_lock_held(uobj->vmobjlock)) || (flags & PGO_LOCKED) == 0" failed: file
> "/usr/src/sys/uvm/uvm_vnode.c", line 953
> cpu1: kernel diagnostic assertion "anon == NULL || anon->an_lock == NULL ||
> rw_write_held(anon->an_lock)" failed: file "/usr/src/sys/uvm/uvm_page.c",
> line 698
>
> ddb{24}> trace
> db_enter() at panic+0x160
> panic() at pool_do_get+0x2e0
> pool_do_get() at pool_get+0x84
> pool_get() at pmap_vp_enter+0x10c
> pmap_vp_enter() at pmap_enter+0x1c0
> pmap_enter() at uvm_fault_lower+0x5d8
> uvm_fault_lower() at uvm_fault+0x174
> uvm_fault() at udata_abort+0x13c
> udata_abort() at do_el0_sync+0x110
> do_el0_sync() at handle_el0_sync+0x74
> handle_el0_sync() at 0x46a81acf4
> --- trap ---
>
> ddb{24}> ps
> PID TID PPID UID S FLAGS WAIT COMMAND
> 58785 188454 39063 0 7 0x2 cc
> 98053 192802 90544 0 7 0x2 perl
> 64630 404985 54292 0 7 0x2 cc
> 39063 67518 27608 0 3 0x10008a sigsusp sh
> 54292 303818 27608 0 3 0x10008a sigsusp sh
> 79622 506282 31140 89 3 0x1100092 kqread relayd
> 22480 244344 31140 89 3 0x1100092 kqread relayd
> 61188 457112 31140 89 3 0x1100092 kqread relayd
> 68881 247109 31140 89 3 0x1100092 kqread relayd
> 31140 172572 44482 0 3 0x82 kqread relayd
> 47885 94001 17253 0 7 0x2 cc
> 90544 80319 74042 0 3 0x100088 sigsusp sh
> 17253 181788 27608 0 3 0x10008a sigsusp sh
> 74042 134570 23576 0 3 0x10008a sigsusp sh
> 72545 184667 70980 0 7 0x2 cc
> 28220 26356 99858 0 7 0x2 cc
> 5990 190458 21959 0 7 0x2 cc
> 70980 380908 27608 0 3 0x10008a sigsusp sh
> 99858 464232 27608 0 3 0x10008a sigsusp sh
> 21959 151087 27608 0 3 0x10008a sigsusp sh
> 59877 330191 93306 0 7 0x2 cc
> 93306 187133 27608 0 3 0x10008a sigsusp sh
> 44482 231326 41508 0 3 0x82 piperd perl
> 41508 452644 38723 0 3 0x10008a sigsusp ksh
> 76560 435901 4073 0 7 0x2 cc
> 4073 69740 27608 0 3 0x10008a sigsusp sh
> 38723 510608 3108 0 3 0x9a kqread sshd
> 62264 338161 8477 0 7 0x2 cc
> 8477 19461 27608 0 3 0x10008a sigsusp sh
> 37096 284696 87287 0 7 0x2 cc
> 87287 222177 27608 0 3 0x10008a sigsusp sh
> 46044 417698 96106 0 7 0x2 cc
> 96106 182045 27608 0 3 0x10008a sigsusp sh
> 20578 245712 79021 0 7 0x2 cc
> 79021 50393 27608 0 3 0x10008a sigsusp sh
> 66581 457535 30585 0 7 0x2 cc
> 19708 286456 20397 0 7 0x2 cc
> 30585 134523 27608 0 3 0x10008a sigsusp sh
> 20397 2347 27608 0 3 0x10008a sigsusp sh
> 62373 17174 55415 0 7 0x2 cc
> *29326 491954 90305 0 7 0x2 cc
> 55415 337134 27608 0 3 0x10008a sigsusp sh
> 90305 134681 27608 0 3 0x10008a sigsusp sh
> 75394 491113 61861 0 7 0x2 cc
> 32193 251667 28050 0 7 0x2 cc
> 61861 123340 27608 0 3 0x10008a sigsusp sh
> 28050 348504 27608 0 3 0x10008a sigsusp sh
> 20116 126851 75067 0 2 0x2 cc
> 20456 29038 28063 0 7 0x2 cc
> 75067 248972 27608 0 3 0x10008a sigsusp sh
> 28063 284169 27608 0 3 0x10008a sigsusp sh
> 41320 470356 74833 0 7 0x2 cc
> 93374 493486 45020 0 7 0x2 cc
> 5505 61195 84135 0 7 0x2 cc
> 74833 310155 27608 0 3 0x10008a sigsusp sh
> 45020 273799 27608 0 3 0x10008a sigsusp sh
> 84135 410073 27608 0 3 0x10008a sigsusp sh
> 6974 309889 63367 0 7 0x2 cc
> 65679 400245 82945 0 7 0x2 cc
> 542 167668 26309 0 7 0x2 cc
> 63367 187361 27608 0 3 0x10008a sigsusp sh
> 82945 342123 27608 0 3 0x10008a sigsusp sh
> 26309 133612 27608 0 3 0x10008a sigsusp sh
> 2993 301719 27608 0 3 0x10008a sigsusp sh
> 75056 102699 8657 0 7 0x2 cc
> 8657 474878 27608 0 3 0x10008a sigsusp sh
> 39409 326579 71504 0 7 0x2 cc
> 71504 262954 27608 0 3 0x10008a sigsusp sh
> 74800 167723 45145 0 7 0x2 cc
> 45145 428976 27608 0 3 0x10008a sigsusp sh
> 47521 201866 28984 0 7 0x2 cc
> 28984 179188 27608 0 3 0x10008a sigsusp sh
> 33287 34425 91823 0 7 0x2 cc
> 91823 441718 27608 0 3 0x10008a sigsusp sh
> 21613 115414 56890 89 3 0x1100092 kqread relayd
> 47619 477807 56890 89 3 0x1100092 kqread relayd
> 71196 248748 56890 89 3 0x1100092 kqread relayd
> 65815 63950 56890 89 3 0x1100092 kqread relayd
> 56890 372120 1 0 3 0x82 kqread relayd
> 23576 239099 89554 0 3 0x10008a sigsusp make
> 89554 189956 17868 0 3 0x10008a sigsusp sh
> 17868 351787 11667 0 3 0x10008a sigsusp make
> 27608 86318 73255 0 3 0x10008a sigsusp make
> 73255 327201 80208 0 3 0x10008a sigsusp ksh
> 80208 14876 3108 0 3 0x9a kqread sshd
> 6976 277108 92295 0 3 0x100082 piperd gzip
> 92295 154145 11667 0 3 0x100082 piperd pax
> 11667 33553 43983 0 3 0x82 piperd perl
> 43983 218879 64570 0 3 0x10008a sigsusp ksh
> 64570 399532 3108 0 3 0x9a kqread sshd
> 37671 54711 10929 0 3 0x100090 netio inetd
> 83134 462744 0 0 3 0x14200 bored sosplice
> 71913 114806 1 0 3 0x100083 ttyin getty
> 48934 341572 1 0 3 0x100083 ttyin getty
> 60040 105400 1 0 3 0x100083 ttyin getty
> 48939 346169 1 0 3 0x100083 ttyin getty
> 76905 382926 1 0 3 0x100083 ttyin getty
> 3934 236983 1 0 3 0x100098 kqread cron
> 2194 439328 1 99 3 0x1100090 kqread sndiod
> 89632 481947 1 110 3 0x100090 kqread sndiod
> 10929 180714 1 0 3 0x100090 kqread inetd
> 10896 313517 49202 95 3 0x1100092 kqread smtpd
> 14149 196592 49202 103 3 0x1100092 kqread smtpd
> 68542 516189 49202 95 3 0x1100092 kqread smtpd
> 91169 442753 49202 95 3 0x100092 kqread smtpd
> 66533 62675 49202 95 3 0x1100092 kqread smtpd
> 18675 437755 49202 95 3 0x1100092 kqread smtpd
> 49202 79929 1 0 3 0x100080 kqread smtpd
> 48426 425617 38531 91 3 0x92 kqread snmpd_metrics
> 38531 204827 1 0 3 0x100080 kqread snmpd
> 61346 237559 1 91 3 0x1100092 kqread snmpd
> 3108 442567 1 0 3 0x88 kqread sshd
> 98260 142823 0 0 3 0x14200 acct acct
> 48689 336696 0 0 3 0x14280 nfsidl nfsio
> 99002 158257 0 0 3 0x14280 nfsidl nfsio
> 21373 144070 0 0 3 0x14280 nfsidl nfsio
> 89460 399016 0 0 3 0x14280 nfsidl nfsio
> 65569 484133 1 0 3 0x100080 kqread ntpd
> 85174 108057 97497 83 3 0x100092 kqread ntpd
> 97497 514161 1 83 3 0x1100092 kqread ntpd
> 64867 33975 53215 74 3 0x1100092 bpf pflogd
> 53215 523547 1 0 3 0x80 netio pflogd
> 66957 126797 89040 73 3 0x1100090 kqread syslogd
> 89040 442426 1 0 3 0x100082 netio syslogd
> 31117 411949 1 0 3 0x100080 kqread resolvd
> 89949 47376 99022 77 3 0x100092 kqread dhcpleased
> 51695 133893 99022 77 3 0x100092 kqread dhcpleased
> 99022 476783 1 0 3 0x80 kqread dhcpleased
> 61397 161123 3938 115 3 0x100092 kqread slaacd
> 97485 503816 3938 115 3 0x100092 kqread slaacd
> 3938 467700 1 0 3 0x100080 kqread slaacd
> 46094 80017 0 0 3 0x14200 bored smr
> 69361 516326 0 0 2 0x14200 zerothread
> 16782 109440 0 0 3 0x14200 aiodoned aiodoned
> 5498 249357 0 0 3 0x14200 syncer update
> 87002 352059 0 0 3 0x14200 cleaner cleaner
> 6933 157912 0 0 7 0x14200 reaper
> 39080 101227 0 0 3 0x14200 pgdaemon pagedaemon
> 63489 298245 0 0 3 0x14200 bored wsdisplay0
> 40437 429745 0 0 3 0x40014200 acpi0 acpi0
> 36678 56675 0 0 3 0x14200 usbtsk usbtask
> 86502 341452 0 0 3 0x14200 usbatsk usbatsk
> 47958 42bored sl 3 0x40014200 idle30
> 2482 368103 0 0 3 0x40014200 idle29
> 37619 92133 0 0 3 0x40014200 idle28
> 4763 479915 0 0 3 0x40014200 idle27
> 8708 161927 0 0 3 0x40014200 idle26
> 80964 116531 0 0 3 0x40014200 idle25
> 37242 43890 0 0 3 0x40014200 idle24
> 20572 185199 0 0 3 0x40014200 idle23
> 27068 467866 0 0 3 0x40014200 idle22
> 64908 75970 0 0 3 0x40014200 idle21
> 4123 434950 0 0 3 0x40014200 idle20
> 94433 78396 0 0 3 0x40014200 idle19
> 82529 497285 0 0 3 0x40014200 idle18
> 68513 262798 0 0 3 0x40014200 idle17
> 75107 309192 0 0 3 0x40014200 idle16
> 60383 212329 0 0 3 0x40014200 idle15
> 38021 135542 0 0 3 0x40014200 idle14
> 90478 220743 0 0 3 0x40014200 idle13
> 52743 435736 0 0 3 0x40014200 idle12
> 51600 201430 0 0 3 0x40014200 idle11
> 9538 151435 0 0 3 0x40014200 idle10
> 97667 277365 0 0 3 0x40014200 idle9
> 55457 177979 0 0 3 0x40014200 idle8
> 22671 217931 0 0 3 0x40014200 idle7
> 85990 396074 0 0 3 0x40014200 idle6
> 26440 413963 0 0 3 0x40014200 idle5
> 89379 109659 0 0 3 0x40014200 idle4
> 53636 369283 0 0 3 0x40014200 idle3
> 55075 309103 0 0 3 0x40014200 idle2
> 28109 78038 0 0 3 0x40014200 idle1
> 69989 207474 0 0 3 0x14200 bored softnet3
> 21433 72909 0 0 3 0x14200 bored softnet2
> 69225 18108 0 0 3 0x14200 bored softnet1
> 64681 348902 0 0 3 0x14200 bored softnet0
> 94793 218699 0 0 3 0x14200 bored systqmp
> 13492 223731 0 0 3 0x14200 bored systq
> 60547 350365 0 0 3 0x14200 tmoslp softclockmp
> 18452 189345 0 0 3 0x40014200 tmoslp softclock
> 7801 256736 0 0 3 0x40014200 idle0
> 2947 343948 0 0 3 0x14200 kmalloc kmthread
> 1 453440 0 0 3 0x82 wait init
> 0 0 -1 0 3 0x10200 scheduler swapper
>
> ddb{24}> show uvm
> Current UVM status:
> pagesize=4096 (0x1000), pagemask=0xfff, pageshift=12
> 32439589 VM pages: 49253 active, 438670 inactive, 1 wired, 30119615 free
> (3764418 zero)
> min 10% (25) anon, 10% (25) vnode, 5% (12) vtext
> freemin=1081319, free-target=1441758, inactive-target=1441759,
> wired-max=10813196
> faults=240478951, traps=0, intrs=0, ctxswitch=54362686 fpuswitch=0
> softint=4455706, syscalls=262996283, kmapent=12
> fault counts:
> noram=0, noanon=0, noamap=0, pgwait=0, pgrele=0
> ok relocks(total)=257511(269806), anget(retries)=175603975(0),
> amapcopy=40006013
> neighbor anon/obj pg=143392090/86302730, gets(lock/unlock)=23256221/269873
> cases: anon=172998495, anoncow=2605480, obj=21725891, prcopy=1517959,
> przero=46320635
> daemon and swap counts:
> woke=50404, revs=50404, scans=0, obscans=0, anscans=0
> busy=0, freed=0, reactivate=0, deactivate=96859865
> pageouts=0, pending=0, nswget=0
> nswapdev=1
> swpages=11453562, swpginuse=0, swpgonly=0 paging=0
> kernel pointers:
> objs(kern)=0xffffff800127d120
>
> ddb{24}> dmesg
> OpenBSD 7.4-current (GENERIC.MP) #16: Fri Nov 3 21:38:55 MDT 2023
> [email protected]:/usr/src/sys/arch/arm64/compile/GENERIC.MP
> real mem = 137121214464 (130768MB)
> avail mem = 132778106880 (126627MB)
> random: good seed from bootblocks
> mainbus0 at root: ACPI
> psci0 at mainbus0: PSCI 1.1, SMCCC 1.0
> efi0 at mainbus0: UEFI 2.7
> efi0: American Megatrends rev 0x5000d
> smbios0 at efi0: SMBIOS 3.2.0
> smbios0: vendor LENOVO version "hve104r-1.15" date 02/26/2021
> smbios0: Lenovo HR330A 7X33CTO1WW
> cpu0 at mainbus0 mpidr 0: Applied Micro X-Gene r3p2
> cpu0: 32KB 64b/line 8-way L1 PIPT I-cache, 32KB 64b/line 8-way L1 D-cache
> cpu0: 256KB 64b/line 32-way L2 cache
> cpu0: CRC32,SHA2,SHA1,AES+PMULL,ASID16
> cpu1 at mainbus0 mpidr 1: Applied Micro X-Gene r3p2
> cpu1: 32KB 64b/line 8-way L1 PIPT I-cache, 32KB 64b/line 8-way L1 D-cache
> cpu1: 256KB 64b/line 32-way L2 cache
> cpu1: CRC32,SHA2,SHA1,AES+PMULL,ASID16
> cpu2 at mainbus0 mpidr 100: Applied Micro X-Gene r3p2
> cpu2: 32KB 64b/line 8-way L1 PIPT I-cache, 32KB 64b/line 8-way L1 D-cache
> cpu2: 256KB 64b/line 32-way L2 cache
> cpu2: CRC32,SHA2,SHA1,AES+PMULL,ASID16
> cpu3 at mainbus0 mpidr 101: Applied Micro X-Gene r3p2
> cpu3: 32KB 64b/line 8-way L1 PIPT I-cache, 32KB 64b/line 8-way L1 D-cache
> cpu3: 256KB 64b/line 32-way L2 cache
> cpu3: CRC32,SHA2,SHA1,AES+PMULL,ASID16
> cpu4 at mainbus0 mpidr 200: Applied Micro X-Gene r3p2
> cpu4: 32KB 64b/line 8-way L1 PIPT I-cache, 32KB 64b/line 8-way L1 D-cache
> cpu4: 256KB 64b/line 32-way L2 cache
> cpu4: CRC32,SHA2,SHA1,AES+PMULL,ASID16
> cpu5 at mainbus0 mpidr 201: Applied Micro X-Gene r3p2
> cpu5: 32KB 64b/line 8-way L1 PIPT I-cache, 32KB 64b/line 8-way L1 D-cache
> cpu5: 256KB 64b/line 32-way L2 cache
> cpu5: CRC32,SHA2,SHA1,AES+PMULL,ASID16
> cpu6 at mainbus0 mpidr 300: Applied Micro X-Gene r3p2
> cpu6: 32KB 64b/line 8-way L1 PIPT I-cache, 32KB 64b/line 8-way L1 D-cache
> cpu6: 256KB 64b/line 32-way L2 cache
> cpu6: CRC32,SHA2,SHA1,AES+PMULL,ASID16
> cpu7 at mainbus0 mpidr 301: Applied Micro X-Gene r3p2
> cpu7: 32KB 64b/line 8-way L1 PIPT I-cache, 32KB 64b/line 8-way L1 D-cache
> cpu7: 256KB 64b/line 32-way L2 cache
> cpu7: CRC32,SHA2,SHA1,AES+PMULL,ASID16
> cpu8 at mainbus0 mpidr 400: Applied Micro X-Gene r3p2
> cpu8: 32KB 64b/line 8-way L1 PIPT I-cache, 32KB 64b/line 8-way L1 D-cache
> cpu8: 256KB 64b/line 32-way L2 cache
> cpu8: CRC32,SHA2,SHA1,AES+PMULL,ASID16
> cpu9 at mainbus0 mpidr 401: Applied Micro X-Gene r3p2
> cpu9: 32KB 64b/line 8-way L1 PIPT I-cache, 32KB 64b/line 8-way L1 D-cache
> cpu9: 256KB 64b/line 32-way L2 cache
> cpu9: CRC32,SHA2,SHA1,AES+PMULL,ASID16
> cpu10 at mainbus0 mpidr 500: Applied Micro X-Gene r3p2
> cpu10: 32KB 64b/line 8-way L1 PIPT I-cache, 32KB 64b/line 8-way L1 D-cache
> cpu10: 256KB 64b/line 32-way L2 cache
> cpu10: CRC32,SHA2,SHA1,AES+PMULL,ASID16
> cpu11 at mainbus0 mpidr 501: Applied Micro X-Gene r3p2
> cpu11: 32KB 64b/line 8-way L1 PIPT I-cache, 32KB 64b/line 8-way L1 D-cache
> cpu11: 256KB 64b/line 32-way L2 cache
> cpu11: CRC32,SHA2,SHA1,AES+PMULL,ASID16
> cpu12 at mainbus0 mpidr 600: Applied Micro X-Gene r3p2
> cpu12: 32KB 64b/line 8-way L1 PIPT I-cache, 32KB 64b/line 8-way L1 D-cache
> cpu12: 256KB 64b/line 32-way L2 cache
> cpu12: CRC32,SHA2,SHA1,AES+PMULL,ASID16
> cpu13 at mainbus0 mpidr 601: Applied Micro X-Gene r3p2
> cpu13: 32KB 64b/line 8-way L1 PIPT I-cache, 32KB 64b/line 8-way L1 D-cache
> cpu13: 256KB 64b/line 32-way L2 cache
> cpu13: CRC32,SHA2,SHA1,AES+PMULL,ASID16
> cpu14 at mainbus0 mpidr 700: Applied Micro X-Gene r3p2
> cpu14: 32KB 64b/line 8-way L1 PIPT I-cache, 32KB 64b/line 8-way L1 D-cache
> cpu14: 256KB 64b/line 32-way L2 cache
> cpu14: CRC32,SHA2,SHA1,AES+PMULL,ASID16
> cpu15 at mainbus0 mpidr 701: Applied Micro X-Gene r3p2
> cpu15: 32KB 64b/line 8-way L1 PIPT I-cache, 32KB 64b/line 8-way L1 D-cache
> cpu15: 256KB 64b/line 32-way L2 cache
> cpu15: CRC32,SHA2,SHA1,AES+PMULL,ASID16
> cpu16 at mainbus0 mpidr 800: Applied Micro X-Gene r3p2
> cpu16: 32KB 64b/line 8-way L1 PIPT I-cache, 32KB 64b/line 8-way L1 D-cache
> cpu16: 256KB 64b/line 32-way L2 cache
> cpu16: CRC32,SHA2,SHA1,AES+PMULL,ASID16
> cpu17 at mainbus0 mpidr 801: Applied Micro X-Gene r3p2
> cpu17: 32KB 64b/line 8-way L1 PIPT I-cache, 32KB 64b/line 8-way L1 D-cache
> cpu17: 256KB 64b/line 32-way L2 cache
> cpu17: CRC32,SHA2,SHA1,AES+PMULL,ASID16
> cpu18 at mainbus0 mpidr 900: Applied Micro X-Gene r3p2
> cpu18: 32KB 64b/line 8-way L1 PIPT I-cache, 32KB 64b/line 8-way L1 D-cache
> cpu18: 256KB 64b/line 32-way L2 cache
> cpu18: CRC32,SHA2,SHA1,AES+PMULL,ASID16
> cpu19 at mainbus0 mpidr 901: Applied Micro X-Gene r3p2
> cpu19: 32KB 64b/line 8-way L1 PIPT I-cache, 32KB 64b/line 8-way L1 D-cache
> cpu19: 256KB 64b/line 32-way L2 cache
> cpu19: CRC32,SHA2,SHA1,AES+PMULL,ASID16
> cpu20 at mainbus0 mpidr a00: Applied Micro X-Gene r3p2
> cpu20: 32KB 64b/line 8-way L1 PIPT I-cache, 32KB 64b/line 8-way L1 D-cache
> cpu20: 256KB 64b/line 32-way L2 cache
> cpu20: CRC32,SHA2,SHA1,AES+PMULL,ASID16
> cpu21 at mainbus0 mpidr a01: Applied Micro X-Gene r3p2
> cpu21: 32KB 64b/line 8-way L1 PIPT I-cache, 32KB 64b/line 8-way L1 D-cache
> cpu21: 256KB 64b/line 32-way L2 cache
> cpu21: CRC32,SHA2,SHA1,AES+PMULL,ASID16
> cpu22 at mainbus0 mpidr b00: Applied Micro X-Gene r3p2
> cpu22: 32KB 64b/line 8-way L1 PIPT I-cache, 32KB 64b/line 8-way L1 D-cache
> cpu22: 256KB 64b/line 32-way L2 cache
> cpu22: CRC32,SHA2,SHA1,AES+PMULL,ASID16
> cpu23 at mainbus0 mpidr b01: Applied Micro X-Gene r3p2
> cpu23: 32KB 64b/line 8-way L1 PIPT I-cache, 32KB 64b/line 8-way L1 D-cache
> cpu23: 256KB 64b/line 32-way L2 cache
> cpu23: CRC32,SHA2,SHA1,AES+PMULL,ASID16
> cpu24 at mainbus0 mpidr c00: Applied Micro X-Gene r3p2
> cpu24: 32KB 64b/line 8-way L1 PIPT I-cache, 32KB 64b/line 8-way L1 D-cache
> cpu24: 256KB 64b/line 32-way L2 cache
> cpu24: CRC32,SHA2,SHA1,AES+PMULL,ASID16
> cpu25 at mainbus0 mpidr c01: Applied Micro X-Gene r3p2
> cpu25: 32KB 64b/line 8-way L1 PIPT I-cache, 32KB 64b/line 8-way L1 D-cache
> cpu25: 256KB 64b/line 32-way L2 cache
> cpu25: CRC32,SHA2,SHA1,AES+PMULL,ASID16
> cpu26 at mainbus0 mpidr d00: Applied Micro X-Gene r3p2
> cpu26: 32KB 64b/line 8-way L1 PIPT I-cache, 32KB 64b/line 8-way L1 D-cache
> cpu26: 256KB 64b/line 32-way L2 cache
> cpu26: CRC32,SHA2,SHA1,AES+PMULL,ASID16
> cpu27 at mainbus0 mpidr d01: Applied Micro X-Gene r3p2
> cpu27: 32KB 64b/line 8-way L1 PIPT I-cache, 32KB 64b/line 8-way L1 D-cache
> cpu27: 256KB 64b/line 32-way L2 cache
> cpu27: CRC32,SHA2,SHA1,AES+PMULL,ASID16
> cpu28 at mainbus0 mpidr e00: Applied Micro X-Gene r3p2
> cpu28: 32KB 64b/line 8-way L1 PIPT I-cache, 32KB 64b/line 8-way L1 D-cache
> cpu28: 256KB 64b/line 32-way L2 cache
> cpu28: CRC32,SHA2,SHA1,AES+PMULL,ASID16
> cpu29 at mainbus0 mpidr e01: Applied Micro X-Gene r3p2
> cpu29: 32KB 64b/line 8-way L1 PIPT I-cache, 32KB 64b/line 8-way L1 D-cache
> cpu29: 256KB 64b/line 32-way L2 cache
> cpu29: CRC32,SHA2,SHA1,AES+PMULL,ASID16
> cpu30 at mainbus0 mpidr f00: Applied Micro X-Gene r3p2
> cpu30: 32KB 64b/line 8-way L1 PIPT I-cache, 32KB 64b/line 8-way L1 D-cache
> cpu30: 256KB 64b/line 32-way L2 cache
> cpu30: CRC32,SHA2,SHA1,AES+PMULL,ASID16
> cpu31 at mainbus0 mpidr f01: Applied Micro X-Gene r3p2
> cpu31: 32KB 64b/line 8-way L1 PIPT I-cache, 32KB 64b/line 8-way L1 D-cache
> cpu31: 256KB 64b/line 32-way L2 cache
> cpu31: CRC32,SHA2,SHA1,AES+PMULL,ASID16
> apm0 at mainbus0
> agintc0 at mainbus0 shift 4:4 nirq 544 nredist 32 ipi: 0, 1, 2:
> "interrupt-controller"
> agintcmsi0 at agintc0
> agtimer0 at mainbus0: 40000 kHz
> acpi0 at mainbus0: ACPI 6.1
> acpi0: sleep states
> acpi0: tables DSDT FACP FIDT DBG2 GTDT IORT MCFG SSDT SPMI APIC PCCT SPCR
> PPTT PPTT
> acpi0: wakeup devices
> acpiiort0 at acpi0
> smmu0 at acpiiort0 addr 0x14000000/0x100000: 128 CBs (128 S2-only)
> smmu1 at acpiiort0 addr 0x15000000/0x100000: 128 CBs (128 S2-only)
> acpimcfg0 at acpi0
> acpimcfg0: addr 0x10000000000, bus 0-31
> acpimcfg0: addr 0x7800000000, bus 0-31
> acpimcfg0: addr 0x1000000000, bus 0-31
> acpimcfg0: addr 0x5800000000, bus 0-31
> acpimcfg0: addr 0x6000000000, bus 0-31
> acpimcfg0: addr 0x7000000000, bus 0-7
> acpimcfg0: addr 0x600000000, bus 0-7
> acpimcfg0: addr 0x400000000, bus 0-7
> "ACPI0010" at acpi0 not configured
> "ACPI0007" at acpi0 not configured
> "ACPI0007" at acpi0 not configured
> "ACPI0010" at acpi0 not configured
> "ACPI0007" at acpi0 not configured
> "ACPI0007" at acpi0 not configured
> "ACPI0010" at acpi0 not configured
> "ACPI0007" at acpi0 not configured
> "ACPI0007" at acpi0 not configured
> "ACPI0010" at acpi0 not configured
> "ACPI0007" at acpi0 not configured
> "ACPI0007" at acpi0 not configured
> "ACPI0010" at acpi0 not configured
> "ACPI0007" at acpi0 not configured
> "ACPI0007" at acpi0 not configured
> "ACPI0010" at acpi0 not configured
> "ACPI0007" at acpi0 not configured
> "ACPI0007" at acpi0 not configured
> "ACPI0010" at acpi0 not configured
> "ACPI0007" at acpi0 not configured
> "ACPI0007" at acpi0 not configured
> "ACPI0010" at acpi0 not configured
> "ACPI0007" at acpi0 not configured
> "ACPI0007" at acpi0 not configured
> "ACPI0010" at acpi0 not configured
> "ACPI0007" at acpi0 not configured
> "ACPI0007" at acpi0 not configured
> "ACPI0010" at acpi0 not configured
> "ACPI0007" at acpi0 not configured
> "ACPI0007" at acpi0 not configured
> "ACPI0010" at acpi0 not configured
> "ACPI0007" at acpi0 not configured
> "ACPI0007" at acpi0 not configured
> "ACPI0010" at acpi0 not configured
> "ACPI0007" at acpi0 not configured
> "ACPI0007" at acpi0 not configured
> "ACPI0010" at acpi0 not configured
> "ACPI0007" at acpi0 not configured
> "ACPI0007" at acpi0 not configured
> "ACPI0010" at acpi0 not configured
> "ACPI0007" at acpi0 not configured
> "ACPI0007" at acpi0 not configured
> "ACPI0010" at acpi0 not configured
> "ACPI0007" at acpi0 not configured
> "ACPI0007" at acpi0 not configured
> "ACPI0010" at acpi0 not configured
> "ACPI0007" at acpi0 not configured
> "ACPI0007" at acpi0 not configured
> "APMC0D40" at acpi0 not configured
> "APMC0D40" at acpi0 not configured
> dwiic0 at acpi0 I2C4 addr 0x126b0000/0x1000 irq 105
> iic0 at dwiic0
> ipmi0 at iic0 addr 0x10: version 2.0 interface SSIF
> pluart0 at acpi0 URT0 addr 0x12600000/0x1000 irq 98
> pluart0: console
> pluart1 at acpi0 URT1 addr 0x12610000/0x1000 irq 99
> ahci0 at acpi0 SAT0 addr 0x1c000000/0x1000 irq 111: AHCI 1.3.1
> ahci0: port 0: 6.0Gb/s
> scsibus0 at ahci0: 32 targets
> sd0 at scsibus0 targ 0 lun 0: <ATA, Micron_5200_MTFD, D1M>
> naa.500a075120fc271d
> sd0: 457862MB, 512 bytes/sector, 937703088 sectors, thin
> ahci1 at acpi0 SAT1 addr 0x1c100000/0x1000 irq 112: AHCI 1.3.1
> scsibus1 at ahci1: 32 targets
> xhci0 at acpi0 USB0 addr 0x13800000/0x100000 irq 115, xHCI 1.10
> usb0 at xhci0: USB revision 3.0
> uhub0 at usb0 configuration 1 interface 0 "Generic xHCI root hub" rev
> 3.00/1.00 addr 1
> xhci1 at acpi0 USB1 addr 0x13900000/0x100000 irq 116, xHCI 1.10
> usb1 at xhci1: USB revision 3.0
> uhub1 at usb1 configuration 1 interface 0 "Generic xHCI root hub" rev
> 3.00/1.00 addr 1
> acpibtn0 at acpi0: PWRB
> acpige0 at acpi0 irq 84
> acpige1 at acpi0 irq 72
> "PNP0C33" at acpi0 not configured
> "LNRO0007" at acpi0 not configured
> "APMC0D83" at acpi0 not configured
> "APMC0D84" at acpi0 not configured
> "APMC0D84" at acpi0 not configured
> "APMC0D84" at acpi0 not configured
> "APMC0D84" at acpi0 not configured
> "APMC0D84" at acpi0 not configured
> "APMC0D84" at acpi0 not configured
> "APMC0D84" at acpi0 not configured
> "APMC0D84" at acpi0 not configured
> "APMC0D87" at acpi0 not configured
> "APMC0D87" at acpi0 not configured
> "APMC0D88" at acpi0 not configured
> "APMC0D88" at acpi0 not configured
> "APMC0D88" at acpi0 not configured
> "APMC0D88" at acpi0 not configured
> "APMC0D88" at acpi0 not configured
> "APMC0D88" at acpi0 not configured
> "APMC0D88" at acpi0 not configured
> "APMC0D88" at acpi0 not configured
> "APMC0D85" at acpi0 not configured
> "APMC0D86" at acpi0 not configured
> acpipci0 at acpi0 PCI0
> pci0 at acpipci0
> ppb0 at pci0 dev 0 function 0 "Ampere eMAG PCIE" rev 0x04: irq 131
> pci1 at ppb0 bus 1
> mcx0 at pci1 dev 0 function 0 "Mellanox ConnectX-4 Lx" rev 0x00: FW
> 14.23.1020, msix, address b8:59:9f:0e:57:54
> mcx1 at pci1 dev 0 function 1 "Mellanox ConnectX-4 Lx" rev 0x00: FW
> 14.23.1020, msix, address b8:59:9f:0e:57:55
> acpipci1 at acpi0 PCI2
> pci2 at acpipci1
> ppb1 at pci2 dev 0 function 0 "Ampere eMAG PCIE" rev 0x04: irq 143
> pci3 at ppb1 bus 1
> em0 at pci3 dev 0 function 0 "Intel I210" rev 0x03: msi, address
> 00:1b:21:e0:6d:40
> acpipci2 at acpi0 PCI3
> pci4 at acpipci2
> ppb2 at pci4 dev 0 function 0 "Ampere eMAG PCIE" rev 0x04: irq 149
> pci5 at ppb2 bus 1
> acpipci3 at acpi0 PCI4
> pci6 at acpipci3
> ppb3 at pci6 dev 0 function 0 "Ampere eMAG PCIE" rev 0x04: irq 155
> pci7 at ppb3 bus 1
> acpipci4 at acpi0 PCI5
> pci8 at acpipci4
> ppb4 at pci8 dev 0 function 0 "Ampere eMAG PCIE" rev 0x04: irq 161
> pci9 at ppb4 bus 1
> acpipci5 at acpi0 PCI6
> pci10 at acpipci5
> ppb5 at pci10 dev 0 function 0 "Ampere eMAG PCIE" rev 0x04: irq 167
> pci11 at ppb5 bus 1
> acpipci6 at acpi0 PCI7
> pci12 at acpipci6
> 0:0:0: bridge io address conflict 0x10000000/0x1000
> ppb6 at pci12 dev 0 function 0 "Ampere eMAG PCIE" rev 0x04: irq 173
> pci13 at ppb6 bus 1
> 1:0:0: bridge io address conflict 0x10000000/0x1000
> ppb7 at pci13 dev 0 function 0 "ASPEED Technology AST1150 PCI" rev 0x04
> pci14 at ppb7 bus 2
> 2:0:0: io address conflict 0x10000000/0x80
> "ASPEED Technology AST2000" rev 0x41 at pci14 dev 0 function 0 not configured
> simplefb0 at mainbus0: 1024x768, 32bpp
> wsdisplay0 at simplefb0 mux 1
> wsdisplay0: screen 0-5 added (std, vt100 emulation)
> dwiic0: timed out waiting for tx_empty intr
> uhub2 at uhub0 port 1 configuration 1 interface 0 "American Megatrends Inc.
> Virtual Hub" rev 2.00/1.00 addr 2
> umass0 at uhub2 port 1 configuration 1 interface 0 "American Megatrends Inc.
> Virtual Cdrom Device" rev 2.00/1.00 addr 3
> umass0: using SCSI over Bulk-Only
> scsibus2 at umass0: 2 targets, initiator 0
> cd0 at scsibus2 targ 1 lun 0: <AMI, Virtual CDROM0, 1.00> removable
> serial.046bff20AAABBBBCCCC1
> umass1 at uhub2 port 2 configuration 1 interface 0 "American Megatrends Inc.
> Virtual HardDisk Device" rev 2.00/1.00 addr 4
> umass1: using SCSI over Bulk-Only
> scsibus3 at umass1: 2 targets, initiator 0
> sd1 at scsibus3 targ 1 lun 0: <AMI, Virtual HDisk0, 1.00> removable
> serial.046bff31AAABBBBCCCC3
> uhidev0 at uhub2 port 3 configuration 1 interface 0 "American Megatrends Inc.
> Virtual Keyboard and Mouse" rev 1.10/1.00 addr 5
> uhidev0: iclass 3/1
> ukbd0 at uhidev0: 8 variable keys, 6 key codes
> wskbd0 at ukbd0 mux 1
> wskbd0: connecting to wsdisplay0
> uhidev1 at uhub2 port 3 configuration 1 interface 1 "American Megatrends Inc.
> Virtual Keyboard and Mouse" rev 1.10/1.00 addr 5
> uhidev1: iclass 3/1
> ums0 at uhidev1: 3 buttons, Z dir
> wsmouse0 at ums0 mux 0
> uhub3 at uhub1 port 1 configuration 1 interface 0 "Cypress Semiconductor USB2
> Hub" rev 2.00/90.15 addr 2
> vscsi0 at root
> scsibus4 at vscsi0: 256 targets
> softraid0 at root
> scsibus5 at softraid0: 256 targets
> root on sd0a (141783aac7a83a7b.a) swap on sd0b dump on sd0b
> dwiic0: timed out waiting for rx_full intr
> dwiic0: timed out reading remaining 1
> ipmi0: get chunk: 5,16 fails
> ipmi0: no SDRs IPMI disabled
> <6>arp info overwritten for 10.188.31.30 by 33:33:33:33:33:33 on mcx1
> <3>arp: ether address is broadcast for IP address 10.188.31.30!
> <3>duplicate IP address 10.188.31.31 sent from ethernet address
> 98:03:9b:82:ed:f7
> <3>duplicate IP address 10.188.31.31 sent from ethernet address
> 98:03:9b:82:ed:f7
> <4>arp: attempt to overwrite permanent entry for 10.188.31.188 by
> 98:03:9b:82:ed:f7 on mcx1
> <4>arp: attempt to overwrite permanent entry for 10.188.32.31 by
> 98:03:9b:82:ed:f7 on mcx1
> <4>arp: attempt to overwrite entry for 10.188.32.188 on em0 by
> 98:03:9b:82:ed:f7 on mcx1
> <4>arp: attempt to add entry for 10.188.32.188 on em0 by 98:03:9b:82:ed:f7 on
> mcx1
>
>
