Hello, I am running OBSD 3.8 as my monitoring / proxy
server. I have been having issues with high load
averages (2-2.5) on Nagios (installed chroot by
packages). If I run squid (installed from ports), the
load average goes up into the 6-7's. CPU is 95% free,
Memory is 85-90% free, swap is unused (0K/2048M). My
initial thought was that it was Nagios, but Squid (by
itself) is also running high load averages. I have
other OBSD servers (mail gateways and such) that are
always less than 1.0 load average. When I run vmstat,
there are usually between 3-7 blocked processes
(although I have seen as many as 22), and they are
constant (on every 5 second poll). Eventually (after a
few days), the process becomes unresponsive and I have
to reboot the server. my vmstat -w 5 output is:
procs memory page disks
traps cpu
r b w avm fre flt re pi po fr sr wd0 wd1
int sys cs us sy id
0 4 0 88604 823596 1360 0 0 0 0 0 0 0
423 1628 44 1 1 98
0 3 0 87764 824704 3679 0 0 0 0 0 0 0
417 4113 66 2 7 91
0 4 0 88588 823588 1680 0 0 0 0 0 0 0
354 1705 46 1 2 98
0 3 0 87760 824708 3913 0 0 0 0 0 0 0
310 3561 69 1 3 95
0 3 0 87760 824712 2048 0 0 0 0 0 0 0
389 2388 44 1 6 93
0 4 0 88556 823608 3881 0 0 0 0 0 0 0
444 3547 66 3 2 95
2 3 0 89540 822048 1772 0 0 0 0 0 0 0
414 2721 41 1 8 91
0 3 0 87760 824232 3712 0 0 0 0 0 0 0
381 3459 73 4 3 93
0 3 0 87760 824712 1325 0 0 0 0 0 0 0
371 1291 39 1 1 98
0 3 0 87760 824712 4655 0 0 0 0 0 0 0
391 4463 72 2 7 90
0 3 0 87760 824716 1365 0 0 0 0 0 0 0
414 1381 43 0 2 98
0 3 0 87764 824708 4140 0 0 0 0 0 0 0
396 4502 72 5 5 91
0 3 0 87760 824716 1749 0 0 0 0 0 0 0
438 2109 48 1 3 96
0 5 0 89208 822572 4202 0 0 0 0 0 0 0
433 3952 74 1 4 95
0 3 0 87756 824720 1600 0 0 0 0 0 0 0
472 1597 57 1 2 97
0 3 0 87756 824716 4334 0 0 0 0 0 0 0
426 4491 66 2 7 90
0 3 0 87760 824708 1341 0 0 0 0 0 0 0
452 1291 37 1 2 97
0 3 0 87760 824708 3874 0 0 0 0 0 0 0
450 4270 67 3 7 90
0 3 0 87760 824712 1541 0 0 0 0 0 0 0
340 1477 40 1 1 98
0 3 0 87760 824712 3884 0 0 0 0 0 0 0
406 3496 61 2 3 95
0 4 0 88604 823588 1794 0 0 0 0 0 0 0
393 2239 54 2 5 93
0 3 0 87756 824716 3657 0 0 0 0 0 0 0
422 3410 65 1 3 95
0 3 0 87764 824708 1768 0 0 0 0 0 0 0
438 2125 50 1 3 96
0 3 0 87760 824708 4066 0 0 0 0 0 0 0
455 3654 66 3 2 94
0 4 0 88552 823608 1563 0 0 0 0 0 0 0
392 1519 40 1 1 98
0 3 0 87760 824232 4077 0 0 0 0 0 0 0
430 4207 74 4 3 93
0 3 0 87760 824708 1317 0 0 0 0 0 0 0
424 1280 39 1 1 98
0 4 0 88568 823600 4233 0 0 0 0 0 0 0
460 4659 66 3 7 90
0 3 0 87760 824712 1550 0 0 0 0 0 0 0
415 1507 45 1 1 98
0 3 0 87760 824712 4105 0 0 0 0 0 0 0
419 3688 73 3 3 95
0 4 0 88536 823636 8791 0 0 0 0 0 0 0
440 14787 229 21 13 66
0 3 0 87724 824756 2200 0 0 0 0 0 0 0
278 2221 43 1 2 97
0 3 0 87724 824752 8 0 0 0 0 0 0 0
321 103 17 0 0 100
0 3 0 87724 824756 188 0 0 0 0 0 0 0
357 258 16 0 0 100
0 3 0 87724 824752 7 0 0 0 0 0 0 0
356 90 13 0 0 100
0 7 0 90592 820320 8643 0 0 0 0 0 0 0
514 9263 189 5 15 80
0 3 0 87724 824756 1586 0 0 0 0 0 0 0
301 1597 58 1 1 98
0 4 0 88508 823668 9378 0 0 0 0 0 0 0
374 8348 119 5 7 88
0 4 0 88532 823640 1940 0 0 0 0 0 0 0
343 2299 55 1 6 93
1515 0 189680 712732 19460 0 0 0 0 0 0 0
441 31721 238 33 14 54
622 0 195568 706708 37552 0 0 0 0 0 0 0
575 73375 661 71 29 0
0 6 0 106440 804032 32993 0 0 0 0 0 0 0
675 58724 663 49 29 22
0 7 0 107268 802876 3371 0 0 0 0 0 0 0
417 4513 89 3 6 91
0 7 0 107256 802408 7764 0 0 0 0 0 1 0
402 7988 131 8 9 83
0 6 0 106436 804028 1831 0 0 0 0 0 0 0
390 2514 60 2 2 96
0 5 0 89152 822584 5466 0 0 0 0 0 0 0
420 7000 89 6 5 90
0 4 0 88532 823628 1899 0 0 0 0 0 0 0
444 2725 64 1 6 93
0 3 0 87728 824700 3820 0 0 0 0 0 0 0
434 3614 85 3 2 95
0 3 0 87724 824700 1557 0 0 0 0 0 0 0
395 1481 42 1 2 98
0 4 0 88524 823600 4210 0 0 0 0 0 0 0
440 4218 67 2 7 90
0 3 0 87724 824704 1577 0 0 0 0 0 0 0
422 1537 48 1 2 97
0 3 0 87724 824700 4044 0 0 0 0 0 0 0
390 4441 65 2 7 91
0 3 0 87724 824700 1316 0 0 0 0 0 0 0
328 1274 37 1 1 98
0 3 0 87724 824708 4339 0 0 0 0 0 0 0
378 3978 75 2 4 94
my iostat output is:
iostat
tty wd0 wd1
raid0 cpu
tin tout KB/t t/s MB/s KB/t t/s MB/s KB/t t/s
MB/s us ni sy in id
0 43 19.73 4 0.07 19.79 4 0.07 21.94 4
0.08 4 0 5 0 91
which seems ok to me, although I have a similar
(raidframe) config with another server (PIII 933) with
SCSI drives (this one is SATA) and it is about 1/2 of
this iostat.
I am running this on an HP DL-320 G4 3.4G P4, HT
turned off and 1GB RAM. Custom Kernel (added
RAIDFRAME support). Here is my dmesg:
OpenBSD 3.8-stable (CUSTOM) #0: Mon Dec 12 16:27:08
EST 2005
[EMAIL PROTECTED]:/usr/src/sys/arch/i386/compile/CUSTOM
cpu0: Intel(R) Pentium(R) 4 CPU 3.40GHz
("GenuineIntel" 686-class) 3.40 GHz
cpu0:
FPU,V86,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,SBF,SSE3,MWAIT,CNXT-ID
real mem = 1073270784 (1048116K)
avail mem = 972304384 (949516K)
using 4278 buffers containing 53768192 bytes (52508K)
of memory
mainbus0 (root)
bios0 at mainbus0: AT/286+(00) BIOS, date 12/31/99,
BIOS32 rev. 0 @ 0xf0000
pcibios0 at bios0: rev 2.1 @ 0xf0000/0x2000
pcibios0: PCI BIOS has 6 Interrupt Routing table
entries
pcibios0: no compatible PCI ICU found
pcibios0: Warning, unable to fix up PCI interrupt
routing
pcibios0: PCI bus #5 is the last bus
bios0: ROM list: 0xc0000/0x8000 0xc8000/0x800!
0xc8800/0x3400! 0xcbc00/0x1600 0xee000/0x2000!
cpu0 at mainbus0
pci0 at mainbus0 bus 0: configuration mode 1 (no bios)
pchb0 at pci0 dev 0 function 0 "Intel E7221 MCH Host"
rev 0x05
ppb0 at pci0 dev 1 function 0 "Intel E7221 PCIE" rev
0x05
pci1 at ppb0 bus 1
ppb1 at pci1 dev 0 function 0 "Intel PCIE-PCIE" rev
0x09
pci2 at ppb1 bus 2
bge0 at pci2 dev 1 function 0 "Broadcom BCM5704C" rev
0x10, BCM5704 B0 (0x2100): irq 5 address
00:14:38:4e:78:3a
brgphy0 at bge0 phy 1: BCM5704 10/100/1000baseT PHY,
rev. 0
bge1 at pci2 dev 1 function 1 "Broadcom BCM5704C" rev
0x10, BCM5704 B0 (0x2100): irq 7 address
00:14:38:4e:78:39
brgphy1 at bge1 phy 1: BCM5704 10/100/1000baseT PHY,
rev. 0
ppb2 at pci1 dev 0 function 2 "Intel PCIE-PCIE" rev
0x09
pci3 at ppb2 bus 3
vendor "Symbios Logic", unknown product 0x0054 (class
mass storage subclass SCSI, rev 0x00) at pci3 dev 1
function 0 not configured
ppb3 at pci0 dev 28 function 0 "Intel 82801FB PCIE"
rev 0x03
pci4 at ppb3 bus 4
uhci0 at pci0 dev 29 function 0 "Intel 82801FB USB"
rev 0x03: irq 5
usb0 at uhci0: USB revision 1.0
uhub0 at usb0
uhub0: Intel UHCI root hub, rev 1.00/1.00, addr 1
uhub0: 2 ports with 2 removable, self powered
uhci1 at pci0 dev 29 function 1 "Intel 82801FB USB"
rev 0x03: irq 7
usb1 at uhci1: USB revision 1.0
uhub1 at usb1
uhub1: Intel UHCI root hub, rev 1.00/1.00, addr 1
uhub1: 2 ports with 2 removable, self powered
uhci2 at pci0 dev 29 function 2 "Intel 82801FB USB"
rev 0x03: irq 10
usb2 at uhci2: USB revision 1.0
uhub2 at usb2
uhub2: Intel UHCI root hub, rev 1.00/1.00, addr 1
uhub2: 2 ports with 2 removable, self powered
uhci3 at pci0 dev 29 function 3 "Intel 82801FB USB"
rev 0x03: irq 10
usb3 at uhci3: USB revision 1.0
uhub3 at usb3
uhub3: Intel UHCI root hub, rev 1.00/1.00, addr 1
uhub3: 2 ports with 2 removable, self powered
ehci0 at pci0 dev 29 function 7 "Intel 82801FB USB"
rev 0x03: irq 5
usb4 at ehci0: USB revision 2.0
uhub4 at usb4
uhub4: Intel EHCI root hub, rev 2.00/1.00, addr 1
uhub4: 8 ports with 8 removable, self powered
ppb4 at pci0 dev 30 function 0 "Intel 82801BA AGP" rev
0xd3
pci5 at ppb4 bus 5
vendor "Compaq", unknown product 0xb203 (class system
subclass miscellaneous, rev 0x01) at pci5 dev 2
function 0 not configured
vendor "Compaq", unknown product 0xb204 (class system
subclass miscellaneous, rev 0x01) at pci5 dev 2
function 2 not configured
vga1 at pci5 dev 3 function 0 "ATI Rage XL" rev 0x27
wsdisplay0 at vga1 mux 1: console (80x25, vt100
emulation)
wsdisplay0: screen 1-5 added (80x25, vt100 emulation)
ichpcib0 at pci0 dev 31 function 0 "Intel 82801FB LPC"
rev 0x03: PM disabled
pciide0 at pci0 dev 31 function 1 "Intel 82801FB IDE"
rev 0x03: DMA, channel 0 configured to compatibility,
channel 1 configured to compatibility
pciide0: channel 0 disabled (no drives)
pciide0: channel 1 disabled (no drives)
pciide1 at pci0 dev 31 function 2 "Intel 82801FR SATA"
rev 0x03: DMA, channel 0 configured to native-PCI,
channel 1 configured to native-PCI
pciide1: using irq 7 for native-PCI interrupt
wd0 at pciide1 channel 0 drive 0: <Maxtor 6L080M0>
wd0: 16-sector PIO, LBA48, 76319MB, 156301488 sectors
wd0(pciide1:0:0): using PIO mode 4, Ultra-DMA mode 5
wd1 at pciide1 channel 1 drive 0: <Maxtor 6L080M0>
wd1: 16-sector PIO, LBA48, 76319MB, 156301488 sectors
wd1(pciide1:1:0): using PIO mode 4, Ultra-DMA mode 5
isa0 at ichpcib0
isadma0 at isa0
pckbc0 at isa0 port 0x60/5
pckbd0 at pckbc0 (kbd slot)
pckbc0: using irq 1 for kbd slot
wskbd0 at pckbd0: console keyboard, using wsdisplay0
pms0 at pckbc0 (aux slot)
pckbc0: using irq 12 for aux slot
wsmouse0 at pms0 mux 0
pcppi0 at isa0 port 0x61
midi0 at pcppi0: <PC speaker>
spkr0 at pcppi0
sysbeep0 at pcppi0
npx0 at isa0 port 0xf0/16: using exception 16
pccom0 at isa0 port 0x3f8/8 irq 4: ns16550a, 16 byte
fifo
pccom1 at isa0 port 0x2f8/8 irq 3: ns16550a, 16 byte
fifo
fdc0 at isa0 port 0x3f0/6 irq 6 drq 2
biomask efe5 netmask efe5 ttymask ffe7
pctr: user-level cycle counter enabled
Kernelized RAIDframe activated
raid0 (root): (RAID Level 1) total number of sectors
is 156034176 (76188 MB) as root
dkcsum: wd0 matches BIOS drive 0x80
dkcsum: wd1 matches BIOS drive 0x81
rootdev=0x1300 rrootdev=0x3600 rawdev=0x3602
uhidev0 at uhub0 port 1 configuration 1 interface 0
uhidev0: HP Virtual Management Device, rev 1.10/0.01,
addr 2, iclass 3/1
ums0 at uhidev0
ums0: X report 0x0002 not supported
uhidev1 at uhub1 port 1 configuration 1 interface 0
uhidev1: Avocent USB DSRIQ, rev 1.10/1.00, addr 2,
iclass 3/1
ukbd0 at uhidev1: 8 modifier keys, 6 key codes
wskbd1 at ukbd0 mux 1
wskbd1: connecting to wsdisplay0
uhidev2 at uhub1 port 1 configuration 1 interface 1
uhidev2: Avocent USB DSRIQ, rev 1.10/1.00, addr 2,
iclass 3/1
uhidev2: 3 report ids
ums1 at uhidev2 reportid 1: 5 buttons and Z dir.
wsmouse1 at ums1 mux 0
uhid0 at uhidev2 reportid 2: input=2, output=0,
feature=0
uhid1 at uhidev2 reportid 3: input=1, output=0,
feature=0
Any suggestions or help is greatly appreciated.
Thanks!
