Hello,
I have two machines running OpenBSD 4.2-beta (GENERIC) #338, but this
happened with 4.1-stable as well.
The machines have 8 gigabit interfaces and are only doing routing/nat
with pfsync and carp. It seems that after about 15 days, all memory is
consumed and no resources are available. The machine does not drop
into ddb, but it doesn't do any routing anymore and one cannot log in.
Worse is that it doesn't switch to slave config as carp still works.
The running processes are:
USER PID %CPU %MEM VSZ RSS TT STAT STARTED TIME COMMAND
root 1 0.0 0.0 488 344 ?? Is 9:48AM 0:00.00 /sbin/init
root 30326 0.0 0.1 480 648 ?? Is 9:48AM 0:00.00 syslogd:
[priv] (syslogd)
_syslogd 8338 0.0 0.1 508 700 ?? S 9:48AM 0:00.03 syslogd -a
/var/empty/dev/log
root 13976 0.0 0.0 560 440 ?? Is 9:48AM 0:00.00 pflogd:
[priv] (pflogd)
_pflogd 6715 0.0 0.0 624 376 ?? S 9:48AM 0:04.08 pflogd:
[running] -s 116 -i pflog0 -f /var/log/pflog (pflogd)
root 23821 0.0 0.1 464 744 ?? Is 9:48AM 0:00.00 ntpd: [priv]
(ntpd)
_ntp 26144 0.0 0.1 444 728 ?? S 9:48AM 0:00.01 ntpd: ntp
engine (ntpd)
proxy 5028 0.0 0.1 400 796 ?? Ss 9:48AM 0:00.02
/usr/sbin/ftp-proxy -r -a 193.74.204.2 -m200 -D6
root 3452 0.0 0.1 464 692 ?? Is 9:48AM 0:00.01 inetd
root 21364 0.0 0.2 720 1596 ?? Is 9:48AM 0:00.14 /usr/sbin/sshd
root 9707 0.0 0.1 696 848 ?? Ss 9:48AM 0:00.01 cron
root 22940 0.0 0.2 3212 2292 ?? Ss 9:50AM 0:00.34 sshd: [EMAIL
PROTECTED] (sshd)
root 29071 0.0 0.1 476 524 p0 Ss 9:50AM 0:00.01 -ksh (ksh)
root 9580 0.0 0.0 428 220 p0 R+ 11:02AM 0:00.00 ps -auxww
root 972 0.0 0.1 380 756 00 Is+ 9:48AM 0:00.00
/usr/libexec/getty std.9600 tty00
root 19971 0.0 0.1 320 764 C0 Is+ 9:48AM 0:00.00
/usr/libexec/getty Pc ttyC0
root 4736 0.0 0.1 364 748 C1 Is+ 9:48AM 0:00.00
/usr/libexec/getty Pc ttyC1
root 28778 0.0 0.1 244 748 C2 Is+ 9:48AM 0:00.00
/usr/libexec/getty Pc ttyC2
root 1788 0.0 0.1 408 752 C3 Is+ 9:48AM 0:00.00
/usr/libexec/getty Pc ttyC3
root 13802 0.0 0.1 456 756 C5 Is+ 9:48AM 0:00.00
/usr/libexec/getty Pc ttyC5
So nothing really overly complex here.
top show this for a machine with 7 days uptime:
20 processes: 19 idle, 1 on processor
CPU states: 0.0% user, 0.0% nice, 0.1% system, 9.8% interrupt, 90.1% idle
Memory: Real: 6816K/620M act/tot Free: 380M Swap: 0K/1024M used/tot
As you can see, virtual memory is pretty high and raises constantly.
The machine has only 5 carp interfaces and 5 real interfaces (4 sk and 1 msk)
up.
Any input on what the problem could be would be great.
Feel free to ask me to make some tests.
Some sysctls are set over the default:
net.inet.ip.forwarding=1
ddb.panic=0
ddb.console=1
kern.maxclusters=65535
net.inet.ip.redirect=0
net.inet6.ip6.redirect=0
net.inet.carp.preempt=1
net.inet.carp.log=1
# netstat -m
2123 mbufs in use:
2109 mbufs allocated to data
11 mbufs allocated to packet headers
3 mbufs allocated to socket names and addresses
2/146/65536 mbuf clusters in use (current/peak/max)
2176 Kbytes allocated to network (24% in use)
0 requests for memory denied
0 requests for memory delayed
0 calls to protocol drain routines
dmesg is here:
OpenBSD 4.2-beta (GENERIC) #338: Fri Jul 27 03:00:11 MDT 2007
[EMAIL PROTECTED]:/usr/src/sys/arch/i386/compile/GENERIC
cpu0: Intel(R) Pentium(R) 4 CPU 3.20GHz ("GenuineIntel" 686-class) 3.21 GHz
cpu0:
FPU,V86,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,SBF,SSE3,MWAIT,DS-CPL,CNXT-ID,CX16,xTPR
real mem = 1072197632 (1022MB)
avail mem = 1029156864 (981MB)
mainbus0 at root
bios0 at mainbus0: AT/286+ BIOS, date 08/29/05, BIOS32 rev. 0 @ 0xf9680, SMBIOS
rev. 2.2 @ 0xf0800 (39 entries)
apm0 at bios0: Power Management spec V1.2
apm0: AC on, battery charge unknown
apm0: flags 70102 dobusy 1 doidle 1
pcibios0 at bios0: rev 3.0 @ 0xf0000/0xbde4
pcibios0: PCI IRQ Routing Table rev 1.0 @ 0xfbca0/272 (15 entries)
pcibios0: PCI Exclusive IRQs: 5 9 10 11 12
pcibios0: PCI Interrupt Router at 000:31:0 ("Intel 82801FB LPC" rev 0x00)
pcibios0: PCI bus #5 is the last bus
bios0: ROM list: 0xc0000/0xa800! 0xcc000/0x8000! 0xef000/0x1000!
cpu0 at mainbus0
pci0 at mainbus0 bus 0: configuration mode 1 (no bios)
pchb0 at pci0 dev 0 function 0 "Intel 82915G/P/GV Host" rev 0x0e
vga1 at pci0 dev 2 function 0 "Intel 82915G/P/GV Video" rev 0x0e: aperture at
0xc0000000, size 0x10000000
wsdisplay0 at vga1 mux 1: console (80x25, vt100 emulation)
wsdisplay0: screen 1-5 added (80x25, vt100 emulation)
ppb0 at pci0 dev 28 function 0 "Intel 82801FB PCIE" rev 0x04
pci1 at ppb0 bus 1
mskc0 at pci1 dev 0 function 0 "Marvell Yukon 88E8053" rev 0x15, Yukon-2 EC
rev. A3 (0x2): irq 5
msk0 at mskc0 port A: address 00:10:f3:0e:cb:2d
eephy0 at msk0 phy 0: Marvell 88E1111 Gigabit PHY, rev. 2
ppb1 at pci0 dev 28 function 1 "Intel 82801FB PCIE" rev 0x04
pci2 at ppb1 bus 2
mskc1 at pci2 dev 0 function 0 "Marvell Yukon 88E8053" rev 0x15, Yukon-2 EC
rev. A3 (0x2): irq 10
msk1 at mskc1 port A: address 00:10:f3:0e:cb:2e
eephy1 at msk1 phy 0: Marvell 88E1111 Gigabit PHY, rev. 2
ppb2 at pci0 dev 28 function 2 "Intel 82801FB PCIE" rev 0x04
pci3 at ppb2 bus 3
mskc2 at pci3 dev 0 function 0 "Marvell Yukon 88E8053" rev 0x15, Yukon-2 EC
rev. A3 (0x2): irq 12
msk2 at mskc2 port A: address 00:10:f3:0e:cb:2f
eephy2 at msk2 phy 0: Marvell 88E1111 Gigabit PHY, rev. 2
ppb3 at pci0 dev 28 function 3 "Intel 82801FB PCIE" rev 0x04
pci4 at ppb3 bus 4
mskc3 at pci4 dev 0 function 0 "Marvell Yukon 88E8053" rev 0x15, Yukon-2 EC
rev. A3 (0x2): irq 11
msk3 at mskc3 port A: address 00:10:f3:0e:cb:30
eephy3 at msk3 phy 0: Marvell 88E1111 Gigabit PHY, rev. 2
uhci0 at pci0 dev 29 function 0 "Intel 82801FB USB" rev 0x04: irq 9
uhci1 at pci0 dev 29 function 1 "Intel 82801FB USB" rev 0x04: irq 11
uhci2 at pci0 dev 29 function 2 "Intel 82801FB USB" rev 0x04: irq 12
ehci0 at pci0 dev 29 function 7 "Intel 82801FB USB" rev 0x04: irq 9
usb0 at ehci0: USB revision 2.0
uhub0 at usb0: Intel EHCI root hub, rev 2.00/1.00, addr 1
ppb4 at pci0 dev 30 function 0 "Intel 82801BA AGP" rev 0xd4
pci5 at ppb4 bus 5
skc0 at pci5 dev 4 function 0 "Marvell Yukon 88E8001/8003/8010" rev 0x13, Yukon
Lite (0x9): irq 5
sk0 at skc0 port A: address 00:10:f3:0e:cb:29
eephy4 at sk0 phy 0: Marvell 88E1011 Gigabit PHY, rev. 5
skc1 at pci5 dev 5 function 0 "Marvell Yukon 88E8001/8003/8010" rev 0x13, Yukon
Lite (0x9): irq 11
sk1 at skc1 port A: address 00:10:f3:0e:cb:2a
eephy5 at sk1 phy 0: Marvell 88E1011 Gigabit PHY, rev. 5
skc2 at pci5 dev 6 function 0 "Marvell Yukon 88E8001/8003/8010" rev 0x13, Yukon
Lite (0x9): irq 12
sk2 at skc2 port A: address 00:10:f3:0e:cb:2b
eephy6 at sk2 phy 0: Marvell 88E1011 Gigabit PHY, rev. 5
skc3 at pci5 dev 7 function 0 "Marvell Yukon 88E8001/8003/8010" rev 0x13, Yukon
Lite (0x9): irq 10
sk3 at skc3 port A: address 00:10:f3:0e:cb:2c
eephy7 at sk3 phy 0: Marvell 88E1011 Gigabit PHY, rev. 5
ichpcib0 at pci0 dev 31 function 0 "Intel 82801FB LPC" rev 0x04: PM disabled
pciide0 at pci0 dev 31 function 1 "Intel 82801FB IDE" rev 0x04: DMA, channel 0
configured to compatibility, channel 1 configured to compatibility
wd0 at pciide0 channel 0 drive 0: <SILICONSYSTEMS INC 1GB>
wd0: 1-sector PIO, LBA, 999MB, 2046240 sectors
wd0(pciide0:0:0): using PIO mode 4, DMA mode 2
pciide0: channel 1 disabled (no drives)
pciide1 at pci0 dev 31 function 2 "Intel 82801FB SATA" rev 0x04: DMA, channel 0
configured to native-PCI, channel 1 configured to native-PCI
pciide1: using irq 11 for native-PCI interrupt
wd1 at pciide1 channel 0 drive 0: <WDC WD360ADFD-00NLR1>
wd1: 16-sector PIO, LBA48, 35304MB, 72303840 sectors
wd1(pciide1:0:0): using PIO mode 4, Ultra-DMA mode 5
ichiic0 at pci0 dev 31 function 3 "Intel 82801FB SMBus" rev 0x04: irq 11
iic0 at ichiic0
usb1 at uhci0: USB revision 1.0
uhub1 at usb1: Intel UHCI root hub, rev 1.00/1.00, addr 1
usb2 at uhci1: USB revision 1.0
uhub2 at usb2: Intel UHCI root hub, rev 1.00/1.00, addr 1
usb3 at uhci2: USB revision 1.0
uhub3 at usb3: Intel UHCI root hub, rev 1.00/1.00, addr 1
isa0 at ichpcib0
isadma0 at isa0
pckbc0 at isa0 port 0x60/5
pckbd0 at pckbc0 (kbd slot)
pckbc0: using irq 1 for kbd slot
wskbd0 at pckbd0: console keyboard, using wsdisplay0
pcppi0 at isa0 port 0x61
midi0 at pcppi0: <PC speaker>
spkr0 at pcppi0
lpt0 at isa0 port 0x378/4 irq 7
it0 at isa0 port 0x290/8: IT87
npx0 at isa0 port 0xf0/16: reported by CPUID; using exception 16
pccom0 at isa0 port 0x3f8/8 irq 4: ns16550a, 16 byte fifo
pccom0: console
pccom1 at isa0 port 0x2f8/8 irq 3: ns16550a, 16 byte fifo
biomask fb45 netmask ff65 ttymask ffe7
pctr: user-level cycle counter enabled
mtrr: Pentium Pro MTRR support
dkcsum: wd0 matches BIOS drive 0x80
dkcsum: wd1 matches BIOS drive 0x81
root on wd0a swap on wd0b dump on wd0b
