Hi, On 07.03.2013 17:14, Alexandru Florescu wrote: > On 03/07/2013 05:46 PM, Lukas Tribus wrote: >>> When I try with tw_recycle = 0 then I start to get a lot of TIME_WAIT >>> connections and performance degrades quite quickly so I cannot remove it Dont use it! >>> for now >> This indicates you are running out of source ports and it is >> probably why the latency increases with the number of simultaneous >> connections. > By "source ports" you mean exactly what? > It may be that but as you've seen in my sysctl.conf I already added this > net.ipv4.ip_local_port_range = 1025 65000 > that you would need more ip addresses haproxy can bind to and issue requests from there. >> Can you please: >> - check dmesg for kernel errors/warnings while benchmarking > there isn't a new message since 2 hours when I did the latest changes > so no much help there. >> - run vmstat 1 while benchmarking and post the result > here it is, it was taken while mid testing with ab so half is with ab > half after ab finished > /procs -----------memory---------- ---swap-- -----io---- -system-- > ----cpu----// > // r b swpd free buff cache si so bi bo in cs us > sy id wa// > // 1 0 0 235612 105460 157964 0 0 0 0 11545 6428 > 5 21 74 0// > // 0 0 0 235200 105460 157964 0 0 0 0 12896 7497 > 8 18 74 0// > // 1 0 0 234824 105460 157964 0 0 0 0 14740 8578 > 4 28 68 0// > // 1 0 0 235292 105460 157964 0 0 0 0 10976 6423 > 1 18 81 0// > // 1 0 0 235420 105460 157964 0 0 0 0 9668 5898 3 > 20 77 0// > // 1 0 0 234296 105460 157964 0 0 0 0 12969 8001 > 2 25 73 0// > // 1 0 0 234672 105460 157964 0 0 0 0 13888 8529 > 3 23 74 0// > // 0 0 0 235076 105460 157964 0 0 0 0 8081 4717 3 > 18 79 0// > // 1 0 0 235516 105460 157964 0 0 0 0 8465 5026 0 > 13 87 0// > // 0 0 0 235004 105460 157964 0 0 0 0 8770 5223 2 > 18 80 0// > // 0 0 0 235100 105460 157964 0 0 0 0 8635 4921 1 > 18 81 0// > // 0 0 0 234904 105460 157964 0 0 0 0 9532 5805 3 > 21 76 0// > // 0 0 0 234696 105460 157964 0 0 0 0 11013 6468 > 3 20 77 0// > // 0 0 0 235728 105460 157964 0 0 0 0 9707 5185 3 > 14 83 0/ > >> - specify the exact version and build config (haproxy -vv) > /# haproxy -vv// > //HA-Proxy version 1.5-dev17 2012/12/28// > //Copyright 2000-2012 Willy Tarreau <[email protected]>// > // > //Build options :// > // TARGET = linux26// > // CPU = native// > // CC = gcc// > // CFLAGS = -m64 -march=x86-64 -O2 -march=native -g > -fno-strict-aliasing// > // OPTIONS = USE_OPENSSL=1 USE_STATIC_PCRE=1// > // > //Default settings :// > // maxconn = 2000, bufsize = 16384, maxrewrite = 8192, maxpollevents > = 200// > // > //Encrypted password support via crypt(3): yes// > //Built without zlib support (USE_ZLIB not set)// > //Compression algorithms supported : identity// > //Built with OpenSSL version : OpenSSL 0.9.8o 01 Jun 2010// > //OpenSSL library supports TLS extensions : yes// > //OpenSSL library supports SNI : yes// > //OpenSSL library supports prefer-server-ciphers : yes// > // > //Available polling systems :// > // epoll : pref=300, test result OK// > // poll : pref=200, test result OK// > // select : pref=150, test result OK// > //Total: 3 (3 usable), will use epoll.// > // > // > / >> - specify exact linux kernel release (uname -a) > # uname -a > Linux HAproxy 2.6.32-5-amd64 #1 SMP Sun Sep 23 10:07:46 UTC 2012 > x86_64 GNU/Linux > >> >> I'm not sure if it helps in your environment, but could you try the >> "option nolinger" in the backend? > I added it, not much of a difference from what I can see. > > Thank you so much for your assistance on this matter, > Alex > Okay, so can you give us more specs about the hardware you are using? (haproxy, nginx ...), how they are connected and what type of network cards work in this machines?
cheers thomas
