Re: HaProxy Hang

2017-06-07 Thread Dave Cottlehuber
On Wed, 7 Jun 2017, at 10:42, David King wrote: > Just to close the loop on this, last night was the time at which we were > expecting the next hang. All of the servers we updated haproxy to the > patched versions did not hang. The test servers which were running the > older version hung as expecte

Re: HaProxy Hang

2017-06-07 Thread Willy Tarreau
Hi David, On Wed, Jun 07, 2017 at 09:42:58AM +0100, David King wrote: > Just to close the loop on this, last night was the time at which we were > expecting the next hang. All of the servers we updated haproxy to the > patched versions did not hang. The test servers which were running the > older

Re: HaProxy Hang

2017-06-07 Thread David King
Just to close the loop on this, last night was the time at which we were expecting the next hang. All of the servers we updated haproxy to the patched versions did not hang. The test servers which were running the older version hung as expected Thanks so much to everyone who fixed the issue! On 1

Re: HaProxy Hang

2017-04-18 Thread Willy Tarreau
Hi David, On Tue, Apr 18, 2017 at 10:33:40AM +0100, David King wrote: > Hi All > > Just like to confirm Willy's theory, we had the hang at exactly the time > specified this morning. I could recycle myself in a new church of which I would be the prophet... well maybe it already exists, we have th

Re: HaProxy Hang

2017-04-18 Thread David King
Hi All Just like to confirm Willy's theory, we had the hang at exactly the time specified this morning. Sadly due to a bank holiday yesterday in the UK, we didn't set up the truss and monitoring before the hang occurred. Was the hang seen by everyone? Thanks Dave On 6 April 2017 at 14:56, Mar

Re: HaProxy Hang

2017-04-06 Thread Mark S
On Mon, 03 Apr 2017 12:45:57 -0400, Dave Cottlehuber wrote: On Mon, 13 Mar 2017, at 13:31, David King wrote: Hi All Apologies for the delay in response, i've been out of the country for the last week Mark, my gut feeling is that is network related in someway, so thought we could comp

Re: HaProxy Hang

2017-04-05 Thread Willy Tarreau
On Wed, Apr 05, 2017 at 10:10:49AM +0100, David King wrote: > I'm going to keep with version 1.7.2 till then, so we should have a > comparison OK as you like :-) > If we think we may have a hang at Tue Apr 18, 9:38, is there any specific > logging we should set up on a server at that time? Maybe

Re: HaProxy Hang

2017-04-05 Thread David King
I'm going to keep with version 1.7.2 till then, so we should have a comparison If we think we may have a hang at Tue Apr 18, 9:38, is there any specific logging we should set up on a server at that time? is it worth setting at least one server to have nokqueue set at that time? Thanks David On

Re: HaProxy Hang

2017-04-04 Thread Willy Tarreau
Hi all, On Wed, Apr 05, 2017 at 01:34:20AM +0200, Lukas Tribus wrote: > Can we be absolutely positive that those hangs are not directly or > indirectly caused by the bugs Willy already fixed in 1.7.4 and 1.7.5, for > example from the ML thread "Problems with haproxy 1.7.3 on FreeBSD 11.0-p8"? I d

Re: HaProxy Hang

2017-04-04 Thread Dave Cottlehuber
On Wed, 5 Apr 2017, at 01:34, Lukas Tribus wrote: > Hello, > > > Am 05.04.2017 um 00:27 schrieb David King: > > Hi Dave > > > > Thanks for the info, So interestingly we had the crash at exactly the > > same time, so we are 3 for 3 on that > > > > The setups sounds very similar, but given we all

Re: HaProxy Hang

2017-04-04 Thread Lukas Tribus
Hello, Am 05.04.2017 um 00:27 schrieb David King: Hi Dave Thanks for the info, So interestingly we had the crash at exactly the same time, so we are 3 for 3 on that The setups sounds very similar, but given we all saw issue at the same time, it really points to something more global. We

Re: HaProxy Hang

2017-04-04 Thread David King
Hi Dave Thanks for the info, So interestingly we had the crash at exactly the same time, so we are 3 for 3 on that The setups sounds very similar, but given we all saw issue at the same time, it really points to something more global. We are using NTP from our firewalls, which in turn get it fro

Re: HaProxy Hang

2017-04-03 Thread Dave Cottlehuber
On Mon, 13 Mar 2017, at 13:31, David King wrote: > Hi All > > Apologies for the delay in response, i've been out of the country for the > last week > > Mark, my gut feeling is that is network related in someway, so thought we > could compare the networking setup of our systems > > You mentioned

Re: HaProxy Hang

2017-03-13 Thread David King
Hi All Apologies for the delay in response, i've been out of the country for the last week Mark, my gut feeling is that is network related in someway, so thought we could compare the networking setup of our systems You mentioned you see the hang across geo locations, so i assume there isn't laye

Re: HaProxy Hang

2017-03-06 Thread Jerry Scharf
Willy, per your comment on /dev/random exhaustion. I think running haveged on servers doing crypto work is/should be best practice. jerry On 3/6/17 12:02 PM, Willy Tarreau wrote: Hi Mark, On Mon, Mar 06, 2017 at 02:49:28PM -0500, Mark S wrote: As for the timing issue, I can add to the discu

Re: HaProxy Hang

2017-03-06 Thread Mark S
On Mon, 06 Mar 2017 15:02:43 -0500, Willy Tarreau wrote: OK so that means that haproxy could have hung in a day or two, then your case is much more common than one of the other reports. If your fdront LB is fair between the 6 servers, that could be related to a total number of requests or conne

Re: HaProxy Hang

2017-03-06 Thread Willy Tarreau
Hi Mark, On Mon, Mar 06, 2017 at 02:49:28PM -0500, Mark S wrote: > As for the timing issue, I can add to the discussion with a few related data > points. In short, system uptime does not seem to be a commonality to my > situation. thanks! > 1) I had this issue affect 6 servers, spread across 5

Re: HaProxy Hang

2017-03-06 Thread Mark S
On Mon, 06 Mar 2017 01:35:19 -0500, Willy Tarreau wrote: On Fri, Mar 03, 2017 at 07:54:46PM +0300, Dmitry Sivachenko wrote: > On 03 Mar 2017, at 19:36, David King wrote: > > Thanks for the response! > Thats interesting, i don't suppose you have the details of the other issues? First

Re: HaProxy Hang

2017-03-05 Thread Willy Tarreau
On Fri, Mar 03, 2017 at 07:54:46PM +0300, Dmitry Sivachenko wrote: > > > On 03 Mar 2017, at 19:36, David King wrote: > > > > Thanks for the response! > > Thats interesting, i don't suppose you have the details of the other issues? > > > First report is > https://www.mail-archive.com/haproxy@f

Re: HaProxy Hang

2017-03-03 Thread Rainer Duffner
> Am 03.03.2017 um 15:07 schrieb David King : > > Hi All > > Hoping someone will be able to help, we're running a bit of an interesting > setup > > we have 3 HAProxy nodes running freebsd 11.0 , each host runs 4 jails, each > running haproxy, but only one of the jails is under any real load >

Re: HaProxy Hang

2017-03-03 Thread Dmitry Sivachenko
e're running a bit of an interesting > > setup > > > > we have 3 HAProxy nodes running freebsd 11.0 , each host runs 4 jails, each > > running haproxy, but only one of the jails is under any real load > > > > > If my memory does not fail me this is th

Re: HaProxy Hang

2017-03-03 Thread David King
one will be able to help, we're running a bit of an > interesting setup > > > > we have 3 HAProxy nodes running freebsd 11.0 , each host runs 4 jails, > each running haproxy, but only one of the jails is under any real load > > > > > If my memory does not fail

Re: HaProxy Hang

2017-03-03 Thread Dmitry Sivachenko
the jails is under any real load > If my memory does not fail me this is third report on haproxy hang on FreeBSD and all these reports are about FreeBSD-11. I wonder if any one experiences this issue with FreeBSD-10? I am running rather heavy loaded haproxy cluster on FreeBSD-10 (versi

HaProxy Hang

2017-03-03 Thread David King
Hi All Hoping someone will be able to help, we're running a bit of an interesting setup we have 3 HAProxy nodes running freebsd 11.0 , each host runs 4 jails, each running haproxy, but only one of the jails is under any real load we use CARP to balance between the hosts and jails which seems to

Re: HAProxy Hang during initial connection

2014-05-28 Thread Willy Tarreau
Hi John, On Wed, May 28, 2014 at 07:54:20PM +, JDzialo John wrote: > Hi Willy > > Thanks, I'll send future traces to you directly. I understand the hatred of > bulky email files! > > So I think I found the problem but would love your take on it. > > Our web applications and services in ou

RE: HAProxy Hang during initial connection

2014-05-28 Thread JDzialo John
lto:w...@1wt.eu] Sent: Wednesday, May 28, 2014 10:15 AM To: JDzialo John Cc: haproxy@formilux.org; AZabrecky Allan Subject: Re: HAProxy Hang during initial connection Hi John, On Tue, May 27, 2014 at 08:08:27PM +, JDzialo John wrote: > Hi Willy, > > Here is a capture of all traffi

Re: HAProxy Hang during initial connection

2014-05-28 Thread Willy Tarreau
Hi John, On Tue, May 27, 2014 at 08:08:27PM +, JDzialo John wrote: > Hi Willy, > > Here is a capture of all traffic btwn the two servers using the host option. Thank you. > Basically traffic goes from haproxy to a web farm in a round robin fashion. > These individual web servers are accessi

Re: HAProxy Hang during initial connection

2014-05-22 Thread Willy Tarreau
Hi John, On Thu, May 22, 2014 at 12:03:44PM +, JDzialo John wrote: > Hi Willy, > > Our content-length is correct on the header side. This intermittent issue > happens once in a while. In Fiddler it shows that the client is waiting for > the right content-length but only gets a fraction of i

Re: HAProxy Hang during initial connection

2014-05-18 Thread Willy Tarreau
Hi John, On Thu, May 15, 2014 at 05:49:59PM +, JDzialo John wrote: > Hi Guys, > > We have been using haproxy and have loved it and appreciate all the hard work > you have put into this great product. > > I am new to the project and still trying to grasp it's complexities so > forgive me in a

HAProxy Hang during initial connection

2014-05-15 Thread JDzialo John
Hi Guys, We have been using haproxy and have loved it and appreciate all the hard work you have put into this great product. I am new to the project and still trying to grasp it's complexities so forgive me in advance for any ignorance. We have been running haproxy infront of a web farm since