Hi, That is useful to know

Specifically I'm looking to use HAProxy in front of a cluster of backend
servers, with lots of long running connections.

I keep hearing references on Linux to 65K max sockets, implying about 30k
max connections (2 sockets per connection - one in and one out?). This is
not going to be enough for us :(

But I'm struggling to find out if this 65k thing is a fact or a myth. I
found some references suggesting it was per process not per host.

What (roughly) architecture was the 150k connection experience you mentioned
running on?

On 4 June 2010 09:19, Willy Tarreau <[email protected]> wrote:

> On Thu, Jun 03, 2010 at 11:24:55AM -0600, Jason J. W. Williams wrote:
> > Hi Laurie,
> >
> > This thread might be helpful:
> > http://www.mail-archive.com/[email protected]/msg00926.html
>
> yes indeed, there are various tuning knobs depending on the OS.
> Also, haproxy needs to be set up with the appropriate global
> maxconn setting. I'd say that there are several use ranges :
>
>  - below 500 concurrent connections (< 1000 total sockets)
>    => can be launched by any non-privileged user, useful for testing.
>
>  - between 500 and a few thousands (2-3000) : generally requires root
>    privileges, but not much sensible to tuning nor OS optimisations
>    (eg: epoll/kqueue).
>
>  - between a few thousands and a few tens of thousands (30-40000) :
>    really requires fine tuning (source ports, socket buffers, etc)
>    and system-specific optimisations (epoll/kqueue).
>
>  - above : application-specific, must be purposedly built. The
>    performance will greatly depend on the workload, traffic type,
>    packet sizes, etc... and the required tuning will indicate a
>    minimal sizing and sometimes an architecture. I've seen up to
>    150000 connections per machine once, but this was reached via
>    trial and error.
>
> Regards,
> Willy
>
>


-- 
Dr Laurie Young
Scrum Master
New Bamboo

Follow me on twitter: @wildfalcon
Follow us on twitter:  @newbamboo

Creating fresh, flexible and fast-growing web applications is our passion.


3rd Floor, Gensurco House,
46A Rosebery Avenue, London, EC1R 4RP

http://www.new-bamboo.co.uk

Reply via email to