Thanks Vadim, with "set limit state 30000" I now see the states balloon upto nearly 22000 states at peak, and no more "state up -> down".
Peter On 26 February 2013 17:41, Vadim Zhukov <[email protected]> wrote: > 26.02.2013 20:06 ÐÏÌØÚÏ×ÁÔÅÌØ "Peter Farmer" <[email protected]> > ÎÁÐÉÓÁÌ: > > > > > Hi All, > > > > Whilst load testing my website (being balanced via relayd) I see this > from > > time to time (when running "relayd -d"): > > > > relay www, session 2410 (1 active), 0, 195.143.230.243 -> 10.201.0.7:80, > > done > > relay www, session 3479 (1 active), 0, 195.143.230.242 -> 10.201.0.6:80, > > done > > relay www, session 2411 (1 active), 0, 195.143.230.243 -> 10.201.0.6:80, > > done > > relay www, session 3480 (1 active), 0, 195.143.230.242 -> 10.201.0.7:80, > > done > > host 10.201.0.6, check http code (0ms), state up -> down, availability > > 92.31% > > host 10.201.0.7, check http code (0ms), state up -> down, availability > > 84.62% > > relay www, session 2412 (1 active), 0, 195.143.230.242 -> :80, session > > failed > > relay www, session 2413 (1 active), 0, 195.143.230.243 -> :80, session > > failed > > relay www, session 2414 (1 active), 0, 195.143.230.242 -> :80, session > > failed > > > > I also periodically see: > > > > relay www, session 1609 (1 active), 0, 195.143.230.243 -> 10.201.0.6:80, > > session failed > > > > I know that the webservers are available because I also have a tests > > running against each of the webservers and can see they are available all > > the time. > > > > Should I be adding something to relayd.conf or should I be tuning OpenBSD > > is anyway? There are typically between 6000 - 9000 states in the state > > table during the test. > > And default PF limit is 10000. Too close to be safe. Try to set it in > pf.conf to, e.g., 30000 first. > > > The ab command I am running is: > > > > ab -v -c100 -n100000 http://beta.digidayoff.com/ > > > > My relayd conf is: > > > > ext_addr="10.201.0.3" > > www1="10.201.0.6" > > www2="10.201.0.7" > > > > log all > > > > table <webhosts> { $www1 $www2 } > > relay www { > > listen on $ext_addr port http > > forward to <webhosts> port http mode roundrobin check http "/" code > 200 > > } > > > > > > My pf.conf is: > > > > set skip on lo > > anchor "relayd/*" > > pass quick on em1 proto pfsync keep state (no-sync) > > pass on em1 proto carp keep state > > pass # to establish keep-state > > # By default, do not permit remote connections to X11 > > block in on ! lo0 proto tcp to port 6000:6010 > > > > > > dmesg: > > > > OpenBSD 5.2 (GENERIC) #309: Wed Aug 1 09:58:55 MDT 2012 > > [email protected]:/usr/src/sys/arch/amd64/compile/GENERIC > > real mem = 535756800 (510MB) > > avail mem = 499208192 (476MB) > > mainbus0 at root > > bios0 at mainbus0: SMBIOS rev. 2.4 @ 0xe0010 (268 entries) > > bios0: vendor Phoenix Technologies LTD version "6.00" date 09/21/2011 > > bios0: VMware, Inc. VMware Virtual Platform > > acpi0 at bios0: rev 2 > > acpi0: sleep states S0 S1 S4 S5 > > acpi0: tables DSDT FACP BOOT APIC MCFG SRAT HPET WAET > > acpi0: wakeup devices PCI0(S3) USB_(S1) P2P0(S3) S1F0(S3) S2F0(S3) > S3F0(S3) > > S4F0(S3) S5F0(S3) S6F0(S3) S7F0(S3) S8F0(S3) S9F0(S3) Z00S(S3) Z00T(S3) > > Z00U(S3) Z00V(S3) Z00W(S3) Z00X(S3) Z00Y(S3) Z00Z(S3) Z010(S3) Z011(S3) > > Z012(S3) Z013(S3) Z014(S3) Z015(S3) Z016(S3) Z017(S3) Z018(S3) Z019(S3) > > Z01A(S3) Z01B(S3) Z01C(S3) Z01D(S3) Z01E(S3) P2P1(S3) S1F0(S3) S2F0(S3) > > S3F0(S3) S4F0(S3) S5F0(S3) S6F0(S3) S7F0(S3) S8F0(S3) S9F0(S3) Z00S(S3) > > Z00T(S3) Z00U(S3) Z00V(S3) Z00W(S3) Z00X(S3) Z00Y(S3) Z00Z(S3) Z010(S3) > > Z011(S3) Z012(S3) Z013(S3) Z014(S3) Z015(S3) Z016(S3) Z017(S3) Z018(S3) > > Z019(S3) Z01A(S3) Z01B(S3) Z01C(S3) Z01D(S3) Z01E(S3) P2P2(S3) S1F0(S3) > > S2F0(S3) S3F0(S3) S4F0(S3) S5F0(S3) S6F0(S3) S7F0(S3) S8F0(S3) S9F0(S3) > > Z00S(S3) Z00T(S3) Z00U(S3) Z00V(S3) Z00W(S3) Z00X(S3) Z00Y(S3) Z00Z(S3) > > Z010(S3) Z011(S3) Z012(S3) Z013(S3) Z014(S3) Z015(S3) Z016(S3) Z017(S3) > > Z018(S3) Z019(S3) Z01A(S3) Z01B(S3) Z01C(S3) Z01D(S3) Z01E(S3) P2P3(S3) > > S1F0(S3) S2F0(S3) S3F0(S3) S4F0(S3) S5F0(S3) S6F0(S3) S7F0(S3) S8F0(S3) > > S9F0(S3) Z00S(S3) Z00T(S3) Z00U(S3) Z00V(S3) Z00W(S3) Z00X(S3) Z00Y(S3) > > Z00Z(S3) Z010(S3) Z011(S3) Z012(S3) Z013(S3) Z014(S3) Z015(S3) Z016(S3) > > Z017(S3) Z018(S3) Z019(S3) Z01A(S3) Z01B(S3) Z01C(S3) Z01D(S3) Z01E(S3) > > PE40(S3) S1F0(S3) PE50(S3) S1F0(S3) PE60(S3) S1F0(S3) PE70(S3) S1F0(S3) > > PE80(S3) S1F0(S3) PE90(S3) S1F0(S3) PEA0(S3) S1F0(S3) PEB0(S3) S1F0(S3) > > PEC0(S3) S1F0(S3) PED0(S3) S1F0(S3) PEE0(S3) S1F0(S3) PE41(S3) S1F0(S3) > > PE42(S3) S1F0(S3) PE43(S3) S1F0(S3) PE44(S3) S1F0(S3) PE45(S3) S1F0(S3) > > PE46(S3) S1F0(S3) PE47(S3) S1F0(S3) PE51(S3) S1F0(S3) PE52(S3) S1F0(S3) > > PE53(S3) S1F0(S3) PE54(S3) S1F0(S3) PE55(S3) S1F0(S3) PE56(S3) S1F0(S3) > > PE57(S3) S1F0(S3) PE61(S3) S1F0(S3) PE62(S3) S1F0(S3) PE63(S3) S1F0(S3) > > PE64(S3) S1F0(S3) PE65(S3) S1F0(S3) PE66(S3) S1F0(S3) PE67(S3) S1F0(S3) > > PE71(S3) S1F0(S3) PE72(S3) S1F0(S3) PE73(S3) S1F0(S3) PE74(S3) S1F0(S3) > > PE75(S3) S1F0(S3) PE76(S3) S1F0(S3) PE77(S3) S1F0(S3) PE81(S3) S1F0(S3) > > PE82(S3) S1F0(S3) PE83(S3) S1F0(S3) PE84(S3) S1F0(S3) PE85(S3) S1F0(S3) > > PE86(S3) S1F0(S3) PE87(S3) S1F0(S3) PE91(S3) S1F0(S3) PE92(S3) S1F0(S3) > > PE93(S3) S1F0(S3) PE94(S3) S1F0(S3) PE95(S3) S1F0(S3) PE96(S3) S1F0(S3) > > PE97(S3) S1F0(S3) PEA1(S3) S1F0(S3) PEA2(S3) S1F0(S3) PEA3(S3) S1F0(S3) > > PEA4(S3) S1F0(S3) PEA5(S3) S1F0(S3) PEA6(S3) S1F0(S3) PEA7(S3) S1F0(S3) > > PEB1(S3) S1F0(S3) PEB2(S3) S1F0(S3) PEB3(S3) S1F0(S3) PEB4(S3) S1F0(S3) > > PEB5(S3) S1F0(S3) PEB6(S3) S1F0(S3) PEB7(S3) S1F0(S3) SLPB(S4) LID_(S4) > > acpitimer0 at acpi0: 3579545 Hz, 24 bits > > acpimadt0 at acpi0 addr 0xfee00000: PC-AT compat > > cpu0 at mainbus0: apid 0 (boot processor) > > cpu0: Intel(R) Xeon(R) CPU E5-2660 0 @ 2.20GHz, 2199.31 MHz > > cpu0: > > > FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUS H,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,SSE3,PCLMUL,SSSE3,CX16,SSE4.1,SSE4.2,POPCNT,AE S,XSAVE,AVX,NXE,LONG,LAHF > > cpu0: 256KB 64b/line 8-way L2 cache > > cpu0: apic clock running at 65MHz > > ioapic0 at mainbus0: apid 1 pa 0xfec00000, version 11, 24 pins > > acpimcfg0 at acpi0 addr 0xe0000000, bus 0-255 > > acpihpet0 at acpi0: 14318179 Hz > > acpiprt0 at acpi0: bus 0 (PCI0) > > acpicpu0 at acpi0 > > acpibat0 at acpi0: BAT1 not present > > acpibat1 at acpi0: BAT2 not present > > acpiac0 at acpi0: AC unit online > > acpibtn0 at acpi0: SLPB > > acpibtn1 at acpi0: LID_ > > vmt0 at mainbus0 > > pci0 at mainbus0 bus 0 > > pchb0 at pci0 dev 0 function 0 "Intel 82443BX AGP" rev 0x01 > > ppb0 at pci0 dev 1 function 0 "Intel 82443BX AGP" rev 0x01 > > pci1 at ppb0 bus 1 > > pcib0 at pci0 dev 7 function 0 "Intel 82371AB PIIX4 ISA" rev 0x08 > > pciide0 at pci0 dev 7 function 1 "Intel 82371AB IDE" rev 0x01: DMA, > channel > > 0 configured to compatibility, channel 1 configured to compatibility > > wd0 at pciide0 channel 0 drive 0: <VMware Virtual IDE Hard Drive> > > wd0: 64-sector PIO, LBA, 10240MB, 20971520 sectors > > wd0(pciide0:0:0): using PIO mode 4, Ultra-DMA mode 2 > > pciide0: channel 1 disabled (no drives) > > piixpm0 at pci0 dev 7 function 3 "Intel 82371AB Power" rev 0x08: SMBus > > disabled > > "VMware Virtual Machine Communication Interface" rev 0x10 at pci0 dev 7 > > function 7 not configured > > vga1 at pci0 dev 15 function 0 "VMware Virtual SVGA II" rev 0x00 > > wsdisplay0 at vga1 mux 1: console (80x25, vt100 emulation) > > wsdisplay0: screen 1-5 added (80x25, vt100 emulation) > > mpi0 at pci0 dev 16 function 0 "Symbios Logic 53c1030" rev 0x01: apic 1 > int > > 17 > > scsibus0 at mpi0: 16 targets, initiator 7 > > ppb1 at pci0 dev 17 function 0 "VMware Virtual PCI-PCI" rev 0x02 > > pci2 at ppb1 bus 2 > > em0 at pci2 dev 0 function 0 "Intel PRO/1000MT (82545EM)" rev 0x01: apic > 1 > > int 18, address 00:50:56:1c:97:1e > > em1 at pci2 dev 1 function 0 "Intel PRO/1000MT (82545EM)" rev 0x01: apic > 1 > > int 19, address 00:50:56:29:92:bb > > ppb2 at pci0 dev 21 function 0 "VMware Virtual PCIE-PCIE" rev 0x01 > > pci3 at ppb2 bus 3 > > ppb3 at pci0 dev 21 function 1 "VMware Virtual PCIE-PCIE" rev 0x01 > > pci4 at ppb3 bus 4 > > ppb4 at pci0 dev 21 function 2 "VMware Virtual PCIE-PCIE" rev 0x01 > > pci5 at ppb4 bus 5 > > ppb5 at pci0 dev 21 function 3 "VMware Virtual PCIE-PCIE" rev 0x01 > > pci6 at ppb5 bus 6 > > ppb6 at pci0 dev 21 function 4 "VMware Virtual PCIE-PCIE" rev 0x01 > > pci7 at ppb6 bus 7 > > ppb7 at pci0 dev 21 function 5 "VMware Virtual PCIE-PCIE" rev 0x01 > > pci8 at ppb7 bus 8 > > ppb8 at pci0 dev 21 function 6 "VMware Virtual PCIE-PCIE" rev 0x01 > > pci9 at ppb8 bus 9 > > ppb9 at pci0 dev 21 function 7 "VMware Virtual PCIE-PCIE" rev 0x01 > > pci10 at ppb9 bus 10 > > ppb10 at pci0 dev 22 function 0 "VMware Virtual PCIE-PCIE" rev 0x01 > > pci11 at ppb10 bus 11 > > ppb11 at pci0 dev 22 function 1 "VMware Virtual PCIE-PCIE" rev 0x01 > > pci12 at ppb11 bus 12 > > ppb12 at pci0 dev 22 function 2 "VMware Virtual PCIE-PCIE" rev 0x01 > > pci13 at ppb12 bus 13 > > ppb13 at pci0 dev 22 function 3 "VMware Virtual PCIE-PCIE" rev 0x01 > > pci14 at ppb13 bus 14 > > ppb14 at pci0 dev 22 function 4 "VMware Virtual PCIE-PCIE" rev 0x01 > > pci15 at ppb14 bus 15 > > ppb15 at pci0 dev 22 function 5 "VMware Virtual PCIE-PCIE" rev 0x01 > > pci16 at ppb15 bus 16 > > ppb16 at pci0 dev 22 function 6 "VMware Virtual PCIE-PCIE" rev 0x01 > > pci17 at ppb16 bus 17 > > ppb17 at pci0 dev 22 function 7 "VMware Virtual PCIE-PCIE" rev 0x01 > > pci18 at ppb17 bus 18 > > ppb18 at pci0 dev 23 function 0 "VMware Virtual PCIE-PCIE" rev 0x01 > > pci19 at ppb18 bus 19 > > ppb19 at pci0 dev 23 function 1 "VMware Virtual PCIE-PCIE" rev 0x01 > > pci20 at ppb19 bus 20 > > ppb20 at pci0 dev 23 function 2 "VMware Virtual PCIE-PCIE" rev 0x01 > > pci21 at ppb20 bus 21 > > ppb21 at pci0 dev 23 function 3 "VMware Virtual PCIE-PCIE" rev 0x01 > > pci22 at ppb21 bus 22 > > ppb22 at pci0 dev 23 function 4 "VMware Virtual PCIE-PCIE" rev 0x01 > > pci23 at ppb22 bus 23 > > ppb23 at pci0 dev 23 function 5 "VMware Virtual PCIE-PCIE" rev 0x01 > > pci24 at ppb23 bus 24 > > ppb24 at pci0 dev 23 function 6 "VMware Virtual PCIE-PCIE" rev 0x01 > > pci25 at ppb24 bus 25 > > ppb25 at pci0 dev 23 function 7 "VMware Virtual PCIE-PCIE" rev 0x01 > > pci26 at ppb25 bus 26 > > ppb26 at pci0 dev 24 function 0 "VMware Virtual PCIE-PCIE" rev 0x01 > > pci27 at ppb26 bus 27 > > ppb27 at pci0 dev 24 function 1 "VMware Virtual PCIE-PCIE" rev 0x01 > > pci28 at ppb27 bus 28 > > ppb28 at pci0 dev 24 function 2 "VMware Virtual PCIE-PCIE" rev 0x01 > > pci29 at ppb28 bus 29 > > ppb29 at pci0 dev 24 function 3 "VMware Virtual PCIE-PCIE" rev 0x01 > > pci30 at ppb29 bus 30 > > ppb30 at pci0 dev 24 function 4 "VMware Virtual PCIE-PCIE" rev 0x01 > > pci31 at ppb30 bus 31 > > ppb31 at pci0 dev 24 function 5 "VMware Virtual PCIE-PCIE" rev 0x01 > > pci32 at ppb31 bus 32 > > ppb32 at pci0 dev 24 function 6 "VMware Virtual PCIE-PCIE" rev 0x01 > > pci33 at ppb32 bus 33 > > ppb33 at pci0 dev 24 function 7 "VMware Virtual PCIE-PCIE" rev 0x01 > > pci34 at ppb33 bus 34 > > isa0 at pcib0 > > isadma0 at isa0 > > com0 at isa0 port 0x3f8/8 irq 4: ns16550a, 16 byte fifo > > com1 at isa0 port 0x2f8/8 irq 3: ns16550a, 16 byte fifo > > pckbc0 at isa0 port 0x60/5 > > pckbd0 at pckbc0 (kbd slot) > > pckbc0: using irq 1 for kbd slot > > wskbd0 at pckbd0: console keyboard, using wsdisplay0 > > pms0 at pckbc0 (aux slot) > > pckbc0: using irq 12 for aux slot > > wsmouse0 at pms0 mux 0 > > pcppi0 at isa0 port 0x61 > > spkr0 at pcppi0 > > lpt0 at isa0 port 0x378/4 irq 7 > > fdc0 at isa0 port 0x3f0/6 irq 6 drq 2 > > mtrr: Pentium Pro MTRR support > > vscsi0 at root > > scsibus1 at vscsi0: 256 targets > > softraid0 at root > > scsibus2 at softraid0: 256 targets > > root on wd0a (7e2867c9d162711b.a) swap on wd0b dump on wd0b > > > > > > > > Thanks, > > > > Peter
