Hi, at some remote place i'using an axe0 to connect to the ISP's CPE in bridge mode, which hands me a public IP. The CPE had power plug issues, so was randomly disappearing... and required going on-site.
on the same box, i have monit from ports doing various checks and trying to ensure connectivity and daemons keep working fine. Operations done by monit are '/etc/netstart axe0' and 'rcctl restart unbound' when some checks fail: check network outside-link with interface axe0 start program "/bin/sh /etc/netstart axe0" if failed link for 5 cycles then start check network outside-ip with address <public.ip> start program "/bin/sh /etc/netstart axe0" if failed link for 5 cycles then start check process unbound matching unbound restart program "/usr/sbin/rcctl restart unbound" if failed port 53 type udp protocol dns for 2 cycles then restart this works fine, until at some point things accumulate (eg too much CPE downtime), and even if the CPE comes back and things should come back to normal operation mode, i get in a situation where most of the network operations by daemons fail with 'No buffer space available', matching the following patterns: dhcpleased.*: bpf_send_packet: writev: No buffer space available unbound:.*notice: send failed: No buffer space available iked.*: ikev2_msg_send: sendtofrom: No buffer space available from that point, i tried restarting dhcpleased, but the new process kept getting 'No buffer space available' errors. The only 'working workaround' i've found so far is to ifconfig axe0 down/up, which resumes normal operation mode immediately, i get my public ip/dhcp lease, iked reconnects, unbound does its job, etc. i can add a monit check to do the down/up dance when the aforementioned patterns show up in var/log/messages, but i'd be curious in investigating it. What system metric should be monitored via systat to check for that 'buffer space' ? A leak happening because of the numerous netstart calls ? an issue in the axe driver ? hw is: axe0 at uhub0 port 7 configuration 1 interface 0 "ASIX Electronics AX88772" rev 2.00/0.01 addr 2 axe0: AX88772, address 00:14:d1:da:77:4f ukphy0 at axe0 phy 16: Generic IEEE 802.3u media interface, rev. 1: OUI 0x000ec6, model 0x0006 and sometimes does some axe0: usb errors on rx: IOERROR axe0 detached but reattaches immediately, and those msgs cant be correlated to issues with the CPE or the 'No buffer space available' messages. Hints welcome. Landry
OpenBSD 7.2 (GENERIC.MP) #4: Mon Dec 12 06:06:42 MST 2022 r...@syspatch-72-amd64.openbsd.org:/usr/src/sys/arch/amd64/compile/GENERIC.MP real mem = 1835331584 (1750MB) avail mem = 1762369536 (1680MB) random: good seed from bootblocks mpath0 at root scsibus0 at mpath0: 256 targets mainbus0 at root bios0 at mainbus0: SMBIOS rev. 2.4 @ 0xe0000 (43 entries) bios0: vendor Apple Inc. version "MM31.88Z.00AD.B00.0907171535" date 07/17/09 bios0: Apple Inc. Macmini3,1 acpi0 at bios0: ACPI 4.0 acpi0: sleep states S0 S3 S4 S5 acpi0: tables DSDT FACP HPET APIC APIC MCFG ASF! SBST ECDT SSDT SSDT SSDT acpi0: wakeup devices EC__(S3) OHC1(S3) EHC1(S3) OHC2(S3) EHC2(S3) GIGE(S5) ARPT(S5) acpitimer0 at acpi0: 3579545 Hz, 24 bits acpihpet0 at acpi0: 25000000 Hz acpimadt0 at acpi0 addr 0xfee00000: PC-AT compat cpu0 at mainbus0: apid 0 (boot processor) cpu0: Intel(R) Core(TM)2 Duo CPU P7550 @ 2.26GHz, 2255.38 MHz, 06-17-0a cpu0: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,DTES64,MWAIT,DS-CPL,VMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,SSE4.1,XSAVE,NXE,LONG,LAHF,PERF,SENSOR,MELTDOWN cpu0: 32KB 64b/line 8-way D-cache, 32KB 64b/line 8-way I-cache, 3MB 64b/line 12-way L2 cache cpu0: smt 0, core 0, package 0 mtrr: Pentium Pro MTRR support, 8 var ranges, 88 fixed ranges cpu0: apic clock running at 265MHz cpu0: mwait min=64, max=64, C-substates=0.2.2.2.2.1.3, IBE cpu1 at mainbus0: apid 1 (application processor) cpu1: Intel(R) Core(TM)2 Duo CPU P7550 @ 2.26GHz, 2255.36 MHz, 06-17-0a cpu1: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,DTES64,MWAIT,DS-CPL,VMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,SSE4.1,XSAVE,NXE,LONG,LAHF,PERF,SENSOR,MELTDOWN cpu1: 32KB 64b/line 8-way D-cache, 32KB 64b/line 8-way I-cache, 3MB 64b/line 12-way L2 cache cpu1: smt 0, core 1, package 0 ioapic0 at mainbus0: apid 1 pa 0xfec00000, version 11, 24 pins, remapped acpimcfg0 at acpi0 acpimcfg0: addr 0xf0000000, bus 0-255 acpiec0 at acpi0 acpiprt0 at acpi0: bus 0 (PCI0) acpiprt1 at acpi0: bus 2 (IXVE) acpibtn0 at acpi0: PWRB acpibtn1 at acpi0: SLPB acpipci0 at acpi0 PCI0: 0x00000010 0x00000011 0x00000000memory map conflict 0xffc00000/0x400000 asmc0 at acpi0: SMC_ (smc-mcp) addr 0x300/0x20: rev 1.35f535, 154 keys acpicmos0 at acpi0 acpicpu0 at acpi0: !C3(100@57 mwait.3@0x31), !C2(500@1 mwait@0x10), C1(1000@1 mwait), PSS acpicpu1 at acpi0: !C3(100@57 mwait.3@0x31), !C2(500@1 mwait@0x10), C1(1000@1 mwait), PSS cpu0: Enhanced SpeedStep 2255 MHz: speeds: 2261, 2128, 1862, 1596 MHz pci0 at mainbus0 bus 0 0:3:5: mem address conflict 0x93400000/0x80000 pchb0 at pci0 dev 0 function 0 "NVIDIA MCP79 Host" rev 0xb1 "NVIDIA MCP79 Memory" rev 0xb1 at pci0 dev 0 function 1 not configured pcib0 at pci0 dev 3 function 0 "NVIDIA MCP79 ISA" rev 0xb3 "NVIDIA MCP79 Memory" rev 0xb1 at pci0 dev 3 function 1 not configured nviic0 at pci0 dev 3 function 2 "NVIDIA MCP79 SMBus" rev 0xb1 iic0 at nviic0 iic0: addr 0x48 00=11 01=60 02=4b 03=50 04=1c 05=06 08=11 09=60 0a=4b 0b=50 0c=1c 0d=06 10=11 11=60 12=4b 13=50 14=1c 15=06 18=11 19=60 1a=4b 1b=50 1c=1c 1d=06 20=11 21=60 22=4b 23=50 24=1c 25=06 28=11 29=60 2a=4b 2b=50 2c=1c 2d=06 30=11 31=60 32=4b 33=50 34=1c 35=06 38=11 39=60 3a=4b 3b=50 3c=1c 3d=06 40=11 41=60 42=4b 43=50 44=1c 45=06 48=11 49=60 4a=4b 4b=50 4c=1c 4d=06 50=11 51=60 52=4b 53=50 54=1c 55=06 58=11 59=60 5a=4b 5b=50 5c=1c 5d=06 60=11 61=60 62=4b 63=50 64=1c 65=06 68=11 69=60 6a=4b 6b=50 6c=1c 6d=06 70=11 71=60 72=4b 73=50 74=1c 75=06 78=11 79=60 7a=4b 7b=50 7c=1c 7d=06 80=11 81=60 82=4b 83=50 84=1c 85=06 88=11 89=60 8a=4b 8b=50 8c=1c 8d=06 90=11 91=60 92=4b 93=50 94=1c 95=06 98=11 99=60 9a=4b 9b=50 9c=1c 9d=06 a0=11 a1=60 a2=4b a3=50 a4=1c a5=06 a8=11 a9=60 aa=4b ab=50 ac=1c ad=06 b0=11 b1=60 b2=4b b3=50 b4=1c b5=06 b8=11 b9=60 ba=4b bb=50 bc=1c bd=06 c0=11 c1=60 c2=4b c3=50 c4=1c c5=06 c8=11 c9=60 ca=4b cb=50 cc=1c cd=06 d0=11 d1=60 d2=4b d3=50 d4=1c d5=06 d8=11 d9=60 da=4b db=50 dc=1c dd=06 e0=11 e1=60 e2=4b e3=50 e4=1c e5=06 e8=11 e9=60 ea=4b eb=50 ec=1c ed=06 f0=11 f1=60 f2=4b f3=50 f4=1c f5=06 f8=11 f9=60 fa=4b fb=50 fc=1c fd=06 words 00=1130 01=60a0 02=4b00 03=5000 04=1cc0 05=06d0 06=0000 07=0000 spdmem0 at iic0 addr 0x50: 1GB DDR3 SDRAM PC3-8500 SO-DIMM spdmem1 at iic0 addr 0x51: 1GB DDR3 SDRAM PC3-8500 SO-DIMM iic1 at nviic0 "NVIDIA MCP79 Memory" rev 0xb1 at pci0 dev 3 function 3 not configured vendor "NVIDIA", unknown product 0x0a98 (class memory subclass RAM, rev 0xb1) at pci0 dev 3 function 4 not configured "NVIDIA MCP79 Co-processor" rev 0xb1 at pci0 dev 3 function 5 not configured ohci0 at pci0 dev 4 function 0 "NVIDIA MCP79 USB" rev 0xb1: apic 1 int 11, version 1.0, legacy support ehci0 at pci0 dev 4 function 1 "NVIDIA MCP79 USB" rev 0xb1: apic 1 int 10 usb0 at ehci0: USB revision 2.0 uhub0 at usb0 configuration 1 interface 0 "NVIDIA EHCI root hub" rev 2.00/1.00 addr 1 ohci1 at pci0 dev 6 function 0 "NVIDIA MCP79 USB" rev 0xb1: apic 1 int 7, version 1.0, legacy support ehci1 at pci0 dev 6 function 1 "NVIDIA MCP79 USB" rev 0xb1: apic 1 int 5 usb1 at ehci1: USB revision 2.0 uhub1 at usb1 configuration 1 interface 0 "NVIDIA EHCI root hub" rev 2.00/1.00 addr 1 azalia0 at pci0 dev 8 function 0 "NVIDIA MCP79 HD Audio" rev 0xb1: apic 1 int 15 azalia0: codecs: Realtek ALC885 audio0 at azalia0 ppb0 at pci0 dev 9 function 0 "NVIDIA MCP79 PCIE" rev 0xb1 pci1 at ppb0 bus 1 nfe0 at pci0 dev 10 function 0 "NVIDIA MCP79 LAN" rev 0xb1: apic 1 int 14, address 34:15:9e:18:45:58 rgephy0 at nfe0 phy 1: RTL8169S/8110S/8211 PHY, rev. 2 pciide0 at pci0 dev 11 function 0 "NVIDIA MCP79 SATA" rev 0xb1: DMA pciide0: using apic 1 int 11 for native-PCI interrupt wd0 at pciide0 channel 0 drive 0: <Samsung SSD 840 EVO 250GB> wd0: 1-sector PIO, LBA48, 238475MB, 488397168 sectors wd0(pciide0:0:0): using PIO mode 4, Ultra-DMA mode 6 atapiscsi0 at pciide0 channel 1 drive 0 scsibus1 at atapiscsi0: 2 targets cd0 at scsibus1 targ 0 lun 0: <OPTIARC, DVD RW AD-5680H, 3AHB> removable cd0(pciide0:1:0): using PIO mode 4, Ultra-DMA mode 5 ppb1 at pci0 dev 16 function 0 "NVIDIA MCP79 PCIE" rev 0xb1 pci2 at ppb1 bus 2 vga1 at pci2 dev 0 function 0 "NVIDIA GeForce 9400" rev 0xb1 wsdisplay0 at vga1 mux 1: console (80x25, vt100 emulation) wsdisplay0: screen 1-5 added (80x25, vt100 emulation) ppb2 at pci0 dev 21 function 0 "NVIDIA MCP79 PCIE" rev 0xb1: msi pci3 at ppb2 bus 3 "Broadcom BCM4321" rev 0x05 at pci3 dev 0 function 0 not configured ppb3 at pci0 dev 22 function 0 "NVIDIA MCP79 PCIE" rev 0xb1: msi pci4 at ppb3 bus 4 "AT&T/Lucent FW643 1394" rev 0x07 at pci4 dev 0 function 0 not configured isa0 at pcib0 isadma0 at isa0 pcppi0 at isa0 port 0x61 spkr0 at pcppi0 usb2 at ohci0: USB revision 1.0 uhub2 at usb2 configuration 1 interface 0 "NVIDIA OHCI root hub" rev 1.00/1.00 addr 1 usb3 at ohci1: USB revision 1.0 uhub3 at usb3 configuration 1 interface 0 "NVIDIA OHCI root hub" rev 1.00/1.00 addr 1 vmm0 at mainbus0: VMX (using slow L1TF mitigation) axe0 at uhub0 port 7 configuration 1 interface 0 "ASIX Electronics AX88772" rev 2.00/0.01 addr 2 axe0: AX88772, address 00:14:d1:da:77:4f ukphy0 at axe0 phy 16: Generic IEEE 802.3u media interface, rev. 1: OUI 0x000ec6, model 0x0006 uaudio0 at uhub2 port 1 configuration 1 interface 1 "ABC USB Sound Device" rev 1.10/0.10 addr 2 uaudio0: class v1, full-speed, sync, channels: 8 play, 2 rec, 25 ctls audio1 at uaudio0 uhidev0 at uhub2 port 1 configuration 1 interface 3 "ABC USB Sound Device" rev 1.10/0.10 addr 2 uhidev0: iclass 3/0 ucc0 at uhidev0: 10 usages, 3 keys, enum wskbd0 at ucc0 mux 1 wskbd0: connecting to wsdisplay0 uhidev1 at uhub2 port 5 configuration 1 interface 0 "Apple Computer, Inc. IR Receiver" rev 2.00/0.16 addr 3 uhidev1: iclass 3/0, 38 report ids uhid0 at uhidev1 reportid 36: input=4, output=0, feature=0 uhid1 at uhidev1 reportid 37: input=4, output=0, feature=0 uhid2 at uhidev1 reportid 38: input=4, output=0, feature=0 uhub4 at uhub3 port 1 configuration 1 interface 0 "Apple Inc. BRCM2046 Hub" rev 2.00/1.00 addr 2 ugen0 at uhub4 port 1 "Apple Inc. Bluetooth USB Host Controller" rev 2.00/1.80 addr 3 uhidev2 at uhub4 port 2 configuration 1 interface 0 "Apple Computer product 0x820a" rev 2.00/1.00 addr 4 uhidev2: iclass 3/1, 1 report id ukbd0 at uhidev2 reportid 1: 8 variable keys, 6 key codes wskbd1 at ukbd0: console keyboard, using wsdisplay0 uhidev3 at uhub4 port 3 configuration 1 interface 0 "Apple Computer product 0x820b" rev 2.00/1.00 addr 5 uhidev3: iclass 3/1, 2 report ids ums0 at uhidev3 reportid 2: 3 buttons wsmouse0 at ums0 mux 0 uhidev4 at uhub3 port 2 configuration 1 interface 0 "PC Sensors TEMPer" rev 1.10/0.00 addr 6 uhidev4: iclass 3/1 ukbd1 at uhidev4: 8 variable keys, 6 key codes wskbd2 at ukbd1 mux 1 wskbd2: connecting to wsdisplay0 uhidev5 at uhub3 port 2 configuration 1 interface 1 "PC Sensors TEMPer" rev 1.10/0.00 addr 6 uhidev5: iclass 3/1 ugold0 at uhidev5 uhidev6 at uhub3 port 4 configuration 1 interface 0 "Fujitsu Component Type 6 Keyboard" rev 1.00/1.02 addr 7 uhidev6: iclass 3/1 ukbd2 at uhidev6: 8 variable keys, 6 key codes, country code 33 wskbd3 at ukbd2 mux 1 wskbd3: connecting to wsdisplay0 vscsi0 at root scsibus2 at vscsi0: 256 targets softraid0 at root scsibus3 at softraid0: 256 targets root on wd0a (0957f3aec879d14c.a) swap on wd0b dump on wd0b WARNING: / was not properly unmounted WARNING: bad clock chip time WARNING: CHECK AND RESET THE DATE! ugold0: 2 sensors type temperx (temperature and humidity)