Re: Strange Broken Pipe error from Varnish health checks

2023-04-19 Thread Batanun B
George Sent: Monday, April 17, 2023 10:21 AM To: varnish-misc@varnish-cache.org Subject: Strange Broken Pipe error from Varnish health checks Hi, I have a Varnish/nginx cluster running with varnish-7.1.2-1.el7.x86_64 on CentOS 7. The issue I am having comes from the varnish health checks. I am

Re: Strange Broken Pipe error from Varnish health checks

2023-04-18 Thread Guillaume Quintard
Hi George, That pcap only contains HTTP info, it would be super useful to have the TCP packets, (SYN/ACK/FIN) to see who closes the connection on whom. -- Guillaume Quintard On Tue, Apr 18, 2023 at 9:43 AM George wrote: > Hi, > > Attached is the packet capture for the health check > > Please

Re: Strange Broken Pipe error from Varnish health checks

2023-04-18 Thread George
Hi, Attached is the packet capture for the health check Please check and advise. În lun., 17 apr. 2023 la 19:15, Guillaume Quintard < guillaume.quint...@gmail.com> a scris: > That code hasn't moved in a while, so I'd be surprised to see a bug there, > but that's always possible. > Any chance

Re: Strange Broken Pipe error from Varnish health checks

2023-04-18 Thread walid boudebouda
> > > It has: https://github.com/varnishcache/varnish-cache/pull/3886 > This was introduced in 7.3 and he is running 7.1 Walid On Tue, Apr 18, 2023 at 12:24 PM Dridi Boukelmoune wrote: > On Mon, Apr 17, 2023 at 4:17 PM Guillaume Quintard > wrote: > > > > That code hasn't moved in a while,

Re: Strange Broken Pipe error from Varnish health checks

2023-04-18 Thread Dridi Boukelmoune
On Mon, Apr 17, 2023 at 4:17 PM Guillaume Quintard wrote: > > That code hasn't moved in a while, so I'd be surprised to see a bug there, > but that's always possible. > Any chance you could get a tcpdump of a probe request (from connection to > disconnection) so we can see what's going on? It

Re: Strange Broken Pipe error from Varnish health checks

2023-04-17 Thread George
I am not sure how a tcpdump will help in any way. Since all the health check requests are virtually the same. Since the varnish thread that probes the backend dies every once in a while then it will never show anything with tcpdump or I virtually have no way to know when it will die in order to

Re: Strange Broken Pipe error from Varnish health checks

2023-04-17 Thread Guillaume Quintard
That code hasn't moved in a while, so I'd be surprised to see a bug there, but that's always possible. Any chance you could get a tcpdump of a probe request (from connection to disconnection) so we can see what's going on? -- Guillaume Quintard On Mon, Apr 17, 2023 at 9:12 AM George wrote: >

Re: Strange Broken Pipe error from Varnish health checks

2023-04-17 Thread George
Hi, In our case the response body is few bytes (13), header+body is 170 bytes. Can this be a bug related to something else perhaps? Please let me know. Thanks În lun., 17 apr. 2023 la 18:47, Guillaume Quintard < guillaume.quint...@gmail.com> a scris: > Thanks, I looked at the code quickly and

Re: Strange Broken Pipe error from Varnish health checks

2023-04-17 Thread Guillaume Quintard
Thanks, I looked at the code quickly and I'd venture that maybe the /varnish_check is a bit too large and doesn't fit Varnish's probe buffer (we only care about the status line of the response anyway), so Varnish closes the connection while nginx isn't done yet. If it's that, it's not very

Re: Strange Broken Pipe error from Varnish health checks

2023-04-17 Thread George
Hi, Below is the probe "health", I forgot to send it the first time: probe health { .url = "/varnish_check"; .timeout = 2s; .interval = 5s; .window = 3; .threshold = 2; } Thanks În lun., 17 apr. 2023 la

Re: Strange Broken Pipe error from Varnish health checks

2023-04-17 Thread Guillaume Quintard
Hi George, Just to be sure, how is the probe "health" defined in your VCL? Cheers, -- Guillaume Quintard On Mon, Apr 17, 2023 at 1:23 AM George wrote: > Hi, > > I have a Varnish/nginx cluster running with varnish-7.1.2-1.el7.x86_64 on > CentOS 7. > > The issue I am having comes from the

Strange Broken Pipe error from Varnish health checks

2023-04-17 Thread George
Hi, I have a Varnish/nginx cluster running with varnish-7.1.2-1.el7.x86_64 on CentOS 7. The issue I am having comes from the varnish health checks. I am getting a "broken pipe" error in the nginx error log at random times like below: Apr 10 17:32:46 VARNISH-MASTER nginx_varnish_error: 2023/04/10