Greetings Devs, I'm running two Ubiquity ERL's (Edge Router Lite) as local DNS resolvers. I've run into a reproducable crash on boot or shortly there after on both stable and current builds of 6.8. I'm pretty sure I've eliminated hardware issues by purchasing the second unit, switching out the provided USB's on both units and enabling a variation of each of the ports both individually and together. The issue manifests anytime I enable more than one of the available ethernet ports through a hostname.if file. When only one port is enabled/configured the unit seems to run just fine. DDB output attached and some relevant configuration files below:
/etc/dhclient.conf: send host-name "test1"; /etc/hostname.cnmac0: (same config used to enable additional ethernet ports) dhcp inet6 autoconf /etc/ntpd.conf: # $OpenBSD: ntpd.conf,v 1.16 2019/11/06 19:04:12 deraadt Exp $ # # See ntpd.conf(5) and /etc/examples/ntpd.conf servers pool.ntp.org server time.cloudflare.com sensor * constraint from "9.9.9.9" # quad9 v4 without DNS constraint from "2620:fe::fe" # quad9 v6 without DNS constraints from "www.google.com" # intentionally not 8.8.8.8 /etc/rc.conf.local: apmd_flags=NO cron_flags= ntpd_flags=slaacd_flags= smtpd_flags=NO sndiod_flags=NO
unbound_flags= /etc/resolv.conf: # Generated by cnmac0 dhclient search brahman.lannameserver 192.168.11.6 <- first ERL nameserver 192.168.11.8 <- second ERL
lookup file bind
/etc/sysctl.conf
kern.wxabort=1
net.inet.ip.maxqueue=1024
net.inet.ip.mtudisc=0
net.inet.tcp.mssdflt=1440
/var/unbound/etc/unbound.conf:
# $OpenBSD: unbound.conf,v 1.21 2020/10/28 11:35:58 sthen Exp $
server:
access-control: 10.0.0.0/8 allow
access-control: 192.168.0.0/16 allow
access-control: fe80::/10 allow
aggressive-nsec: yes
auto-trust-anchor-file: /var/unbound/db/root.key
cache-max-ttl: 14400
cache-min-ttl: 1200
do-ip4: yes
do-ip6: yes
do-tcp: yes
do-udp: yes
harden-glue: yes
harden-dnssec-stripped: yes
hide-identity: yes
hide-version: yes
include: /var/unbound/etc/adblock.conf
interface: 0.0.0.0
num-threads: 2
port: 53
prefetch: yes
root-hints: /var/unbound/etc/root.hints
rrset-roundrobin: yes
tls-cert-bundle: /etc/ssl/cert.pem
tls-upstream: yes
val-clean-additional: yes
verbosity: 3
use-caps-for-id: yes
forward-zone:
name: "."
forward-tls-upstream: yes
forward-addr: 2620:fe::10@853#dns.quad9.net
forward-addr: 9.9.9.10@853#dns.quad9.net
forward-addr: 2606:4700:4700::1001@853#cloudflare-dns.com
forward-addr: 1.1.1.1@853#cloudflare-dns.com
--
ddb{0}> show panic
the kernel did not panic
ddb{0}> trace
ml_purge+0x30 (18,2f80758937917d0c,365c54d305d4b044,1b6480b3cebae21f) ra 0xfff
fffff81279738 sp 0x980000000ffebcb0, sz 32
arptfree+0x58 (18,531f7b718930e02c,365c54d305d4b044,1b6480b3cebae21f) ra 0xfff
fffff812796d4 sp 0x980000000ffebcd0, sz 48
arptimer+0x124 (18,5051786db640c7f9,365c54d305d4b044,1b6480b3cebae21f) ra 0xff
ffffff811edb3c sp 0x980000000ffebd00, sz 48
softclock_thread+0x28c (18,5051786db640c7f9,365c54d305d4b044,1b6480b3cebae21f)
r
a 0xffffffff81371a64 sp 0x980000000ffebd30, sz 128
proc_trampoline+0x1c (18,5051786db640c7f9,365c54d305d4b044,1b6480b3cebae21f) r
a 0x0 sp 0x980000000ffebdb0, sz 0
User-level: pid 44256
ddb{0}> ps
PID TID PPID UID S FLAGS WAIT COMMAND
17817 29870 49197 0 7 0x100002 ld
49197 363318 58323 0 3 0x10008a pause sh
58323 377385 86652 0 3 0x10008a pause make
22022 16530 1 0 3 0x100083 ttyin getty
86652 459823 1 0 3 0x10008b pause ksh
62793 215799 1 0 3 0x100098 poll cron
2661 492062 1 0 3 0x80 select sshd
80841 432126 1 0 3 0x100080 poll ntpd
49790 299994 19871 83 3 0x100092 poll ntpd
19871 326311 1 83 3 0x100092 poll ntpd
92377 235378 83048 74 3 0x100092 bpf pflogd
83048 154076 1 0 3 0x80 netio pflogd
56042 90939 46800 73 3 0x100090 kqread syslogd
46800 395195 1 0 3 0x100082 netio syslogd
99107 450432 1 77 3 0x100090 poll dhclient
12191 491957 1 0 3 0x80 poll dhclient
42689 355345 1 77 3 0x100090 poll dhclient
16581 315014 1 0 3 0x80 poll dhclient
69554 23516 8218 115 3 0x100092 kqread slaacd
90543 517384 8218 115 3 0x100092 kqread slaacd
8218 94264 1 0 3 0x100080 kqread slaacd
71321 508206 0 0 3 0x14200 bored smr
77989 506655 0 0 3 0x40014200 idle1
43108 131899 0 0 3 0x14200 pgzero zerothread
50761 260882 0 0 3 0x14200 aiodoned aiodoned
14658 511726 0 0 3 0x14200 syncer update
41558 202757 0 0 3 0x14200 cleaner cleaner
76602 254027 0 0 3 0x14200 reaper reaper
38343 75739 0 0 3 0x14200 pgdaemon pagedaemon
96567 355892 0 0 3 0x14200 bored crynlk
79341 119076 0 0 3 0x14200 bored crypto
97009 86801 0 0 3 0x14200 usbtsk usbtask
57862 369939 0 0 3 0x14200 usbatsk usbatsk
65522 348548 0 0 3 0x14200 bored dwc2
21305 309451 0 0 3 0x14200 bored softnet
24772 219352 0 0 2 0x14200 systqmp
11056 449337 0 0 3 0x14200 bored systq
*44256 259097 0 0 7 0x40014200 softclock
38987 201379 0 0 3 0x40014200 idle0
1 160130 0 0 3 0x82 wait init
0 0 -1 0 3 0x10200 scheduler swapper
ddb{1}> mach ddbcpu 0
Stopped at ml_purge+0x30: ld s1,0(a0)
ddb{0}> trace
ml_purge+0x30 (18,2f80758937917d0c,365c54d305d4b044,1b6480b3cebae21f) ra 0xfff
fffff81279738 sp 0x980000000ffebcb0, sz 32
arptfree+0x58 (18,531f7b718930e02c,365c54d305d4b044,1b6480b3cebae21f) ra 0xfff
fffff812796d4 sp 0x980000000ffebcd0, sz 48
arptimer+0x124 (18,5051786db640c7f9,365c54d305d4b044,1b6480b3cebae21f) ra 0xff
ffffff811edb3c sp 0x980000000ffebd00, sz 48
softclock_thread+0x28c (18,5051786db640c7f9,365c54d305d4b044,1b6480b3cebae21f)
r
a 0xffffffff81371a64 sp 0x980000000ffebd30, sz 128
proc_trampoline+0x1c (18,5051786db640c7f9,365c54d305d4b044,1b6480b3cebae21f) r
a 0x0 sp 0x980000000ffebdb0, sz 0
User-level: pid 44256
ddb{0}> mach ddbcpu 1
Stopped at db_enter+0x4: jr ra
db_enter+0x8: nop
ddb{1}> trace
db_enter+0x4 (0,b51abe5d54085b37,688,1) ra 0xffffffff8153ebf8 sp 0x98000000043
a3c80, sz 0
mips64_ipi_ddb+0x30 (0,b51abe5d54085b37,688,1) ra 0xffffffff8153ee48 sp 0x9800
0000043a3c80, sz 16
mips64_ipi_intr+0xe8 (0,62372c9719f9ed5,688,1) ra 0xffffffff810a7708 sp 0x9800
0000043a3c90, sz 32
octciu_ipi_intr+0x90 (0,62372c9719f9ed5,191241cec7021779,1) ra 0xffffffff813f6
578 sp 0x98000000043a3cb0, sz 48
interrupt+0x190 (0,bf170d6cfb8de562,191241cec7021779,1) ra 0xffffffff81569edc s
p 0x98000000043a3ce0, sz 80
k_intr+0xcc (98000000043a3d58,bf170d6cfb8de562,191241cec7021779,ffffffff810d0b4
4) ra 0x0 sp 0x98000000043a3d30, sz 0
(KERNEL INTERRUPT)
_kernel_lock+0x10c (98000000043a3d58,d7a1ba0544233197,191241cec7021779,ffffffff
810d0b44) ra 0xffffffff81423050 sp 0x98000000043a3eb0, sz 32
itsa+0x330 (98000000043a3d58,d7a1ba0544233197,191241cec7021779,ffffffff810d0b44
) ra 0xffffffff81422c9c sp 0x98000000043a3ed0, sz 192
trap+0x1ec (98000000043a3d58,fe1eee3569847101,191241cec7021779,ffffffff810d0b44
) ra 0xffffffff8156a3b8 sp 0x98000000043a3f90, sz 64
u_general+0xf0 (98000000043a3d58,fe1eee3569847101,191241cec7021779,1c4947b7dc)
r
a 0x0 sp 0x98000000043a3fd0, sz 0
User-level: pid 17817
ddb{0}> show uvm
Current UVM status:
pagesize=16384 (0x4000), pagemask=0x3fff, pageshift=14
31831 VM pages: 9543 active, 2029 inactive, 1 wired, 10278 free (1291 zero)
min 10% (25) anon, 10% (25) vnode, 5% (12) vtext
freemin=1061, free-target=1414, inactive-target=0, wired-max=10610
faults=94354, traps=421271, intrs=15295509, ctxswitch=28022 fpuswitch=0
softint=63406, syscalls=210402, kmapent=9
fault counts:
noram=0, noanon=0, noamap=0, pgwait=0, pgrele=0
ok relocks(total)=3358(3360), anget(retries)=43550(0), amapcopy=44553
neighbor anon/obj pg=816/9373, gets(lock/unlock)=20328/3360
cases: anon=35397, anoncow=8153, obj=18508, prcopy=1818, przero=30478
daemon and swap counts:
woke=0, revs=0, scans=0, obscans=0, anscans=0
busy=0, freed=0, reactivate=0, deactivate=0
pageouts=0, pending=0, nswget=0
nswapdev=1
swpages=49151, swpginuse=0, swpgonly=0 paging=0
kernel pointers:
objs(kern)=0xffffffff816e6ed0
ddb{0}> show bcstats
Current Buffer Cache status:
numbufs 8850 busymapped 1, delwri 12
kvaslots 790 avail kva slots 789
bufpages 8850, dmapages 3145, dirtypages 12
pendingreads 0, pendingwrites 0
highflips 7526, highflops 0, dmaflips 34
ddb{0}> dmesg
[ using 740648 bytes of bsd ELF symbol table ]
Copyright (c) 1982, 1986, 1989, 1991, 1993
The Regents of the University of California. All rights reserved.
Copyright (c) 1995-2020 OpenBSD. All rights reserved. https://www.OpenBSD.org
OpenBSD 6.8 (GENERIC.MP) #322: Sun Oct 4 21:22:50 MDT 2020
[email protected]:/usr/src/sys/arch/octeon/compile/GENERIC.MP
real mem = 536870912 (512MB)
avail mem = 521437184 (497MB)
random: good seed from bootblocks
mainbus0 at root: board 20002 rev 2.18, model CN3xxx/CN5xxx
cpu0 at mainbus0: CN50xx CPU rev 0.1 500 MHz, Software FP emulation
cpu0: cache L1-I 32KB 4 way D 16KB 64 way, L2 128KB 8 way
cpu1 at mainbus0: CN50xx CPU rev 0.1 500 MHz, Software FP emulation
cpu1: cache L1-I 32KB 4 way D 16KB 64 way, L2 128KB 8 way
clock0 at mainbus0: int 5
octcrypto0 at mainbus0
iobus0 at mainbus0
simplebus0 at iobus0: "soc"
octciu0 at simplebus0
octsmi0 at simplebus0
octpip0 at simplebus0
octgmx0 at octpip0 interface 0
cnmac0 at octgmx0: port 0 RGMII, address 18:e8:29:4d:78:d6
atphy0 at cnmac0 phy 7: AR8035 10/100/1000 PHY, rev. 2
cnmac1 at octgmx0: port 1 RGMII, address 18:e8:29:4d:78:d7
atphy1 at cnmac1 phy 6: AR8035 10/100/1000 PHY, rev. 2
cnmac2 at octgmx0: port 2 RGMII, address 18:e8:29:4d:78:d8
atphy2 at cnmac2 phy 5: AR8035 10/100/1000 PHY, rev. 2
com0 at simplebus0: ns16550a, 64 byte fifo
com0: console
dwctwo0 at iobus0 base 0x1180068000000 irq 56
usb0 at dwctwo0: USB revision 2.0
uhub0 at usb0 configuration 1 interface 0 "Octeon DWC2 root hub" rev 2.00/1.00 a
ddr 1
octrng0 at iobus0 base 0x1400000000000 irq 0
umass0 at uhub0 port 1 configuration 1 interface 0 "Kingston DataTraveler 2.0" r
ev 2.00/1.00 addr 2
umass0: using SCSI over Bulk-Only
scsibus0 at umass0: 2 targets, initiator 0
sd0 at scsibus0 targ 1 lun 0: <Kingston, DataTraveler 2.0, 1.00> removable seri
al.09306544C3703978D9BB
sd0: 29565MB, 512 bytes/sector, 60549120 sectors
vscsi0 at root
scsibus1 at vscsi0: 256 targets
softraid0 at root
scsibus2 at softraid0: 256 targets
root on sd0a (9544597cc962abe4.a) swap on sd0b dump on sd0b
WARNING: /mnt was not properly unmounted
WARNING: CHECK AND RESET THE DATE!
signature.asc
Description: PGP signature
