Re: A plea for a more useful and discoverable built-in VCL

2023-11-08 Thread Dridi Boukelmoune
On Mon, Nov 6, 2023 at 6:36 AM Guillaume Quintard wrote: > > Hi everybody! > > A bunch of questions I regularly get regarding Varnish behavior revolve > around the built-in vcl, mainly, I get one of these three: > - why is Varnish not caching? > - how come something is happening in vcl_X even

Re: out of workspace (bo)

2023-09-11 Thread Dridi Boukelmoune
Hi Kevyn, On Wed, Aug 30, 2023 at 11:37 AM Kevyn Fyleyssant wrote: > > Here is my VCL : > https://pastebin.com/TpN8r0Um > > And my varnishd command : > /usr/sbin/varnishd -a :8181 -p feature=+http2 -p http_resp_hdr_len=200k -p > http_resp_size=2M -p http_req_hdr_len=200k -p

Re: Conditional requests for cached 404 responses

2023-07-15 Thread Dridi Boukelmoune
On Sat, Jul 15, 2023 at 5:09 AM Guillaume Quintard wrote: > > Hi Mark, > > You are correct: > https://github.com/varnishcache/varnish-cache/blob/varnish-7.3.0/bin/varnishd/cache/cache_fetch.c#L699-L703 > > We only set the OF_IMSCAND flag (that we use to say that we can conditional > download)

Re: varnishlog record length

2023-07-13 Thread Dridi Boukelmoune
On Thu, Jul 13, 2023 at 9:46 AM Luca Gervasi wrote: > > Hi, > i'm helping to fix some issues with cookies (number, length...) thus I need > to dump all the cookies in every request (tied with the host header). I tried > with varnishlog but the actual value is limited (in our configuration) to ~

Re: Question about changes to ESI processing, possible feature request

2023-06-21 Thread Dridi Boukelmoune
On Thu, Jun 22, 2023 at 12:28 AM Daniel Karp wrote: > > Hi, this is, I think, my first post to a varnish mailing list--I hope > this is the right place for this. Welcome! > Varnish 7.3 changes the way it handles errors for Edge-side includes. > Previously, the body of an ESI response would be

Re: Issue with passing Cache-Control: no-cache header to Tomcat during cache misses

2023-06-15 Thread Dridi Boukelmoune
On Thu, Jun 15, 2023 at 9:33 AM Uday Kumar wrote: > > >> There is this in the code: >> >> > H("Cache-Control", H_Cache_Control, F ) // 2616 >> > 14.9 >> >> We remove the this header when we create a normal fetch task, hence >> the F flag. There's a reference to RFC2616

Re: Issue with passing Cache-Control: no-cache header to Tomcat during cache misses

2023-06-14 Thread Dridi Boukelmoune
On Wed, Jun 14, 2023 at 9:02 AM Uday Kumar wrote: > > Hi Guillaume, > > Thanks for the response. > > Can you provide us with a log of the transaction please? > > I have sent a Request to VARNISH which Contains Cache-Control: no-cache > header, we have made sure the request with cache-control

Re: Mysterious no content result, from an URL with pass action

2023-06-06 Thread Dridi Boukelmoune
On Tue, Jun 6, 2023 at 12:07 PM Jakob Bohm wrote: > > Hi all, > > Just a quick update, > > After changing the hitch to varnish connection from AF_UNIX to TCP, > rerunning the experiment with tcpdump active revealed that varnish > 7.2.1 seemed to silently ignore HTTP/2 requests whenever my browser

Re: Is there any "try catch" functionality in VCL? If not, how to handle runtime errors in vcl_init?

2023-04-19 Thread Dridi Boukelmoune
On Wed, Apr 19, 2023 at 4:25 PM Batanun B wrote: > > Hi, > > We use the vmod crypto to verify cryptographic signatures for some of our > traffic. When testing, the public key was hard coded in the VCL, but before > we start using this feature in production we will switch to reading the >

Re: Possible to disable/inactivate a backend using VCL?

2023-04-19 Thread Dridi Boukelmoune
On Wed, Apr 19, 2023 at 3:45 PM Batanun B wrote: > > > backend theBackend none; > > Here's the relevant documentation: > > https://varnish-cache.org/docs/trunk/users-guide/vcl-backends.html#the-none-backend > > It was added in 6.4. > > Look like exactly what we need! Sadly we are "stuck" on 6.0

Re: Varnish won't start because backend host resolves to too many addresses, but they are all identical IPs

2023-04-19 Thread Dridi Boukelmoune
On Wed, Apr 19, 2023 at 2:44 PM Guillaume Quintard wrote: > > The fact the IPs are identical is weird, but I wouldn't be surprised if the > dns entry actually contained 3 identical IPs. > > > Shouldn't Varnish be able to figure out that in that case it can just > > choose any one and it will

Re: Improved github issue templates

2023-04-18 Thread Dridi Boukelmoune
On Tue, Apr 18, 2023 at 3:05 PM kokoniimasu wrote: > > Hi, > > Varnish already have a issue template, but sometimes I see people ignore it > and post questions, etc. (they are closed right away) > > I saw a post on Twitter about the great categorization of issues in > ImageMagick. > >

Re: Strange Broken Pipe error from Varnish health checks

2023-04-18 Thread Dridi Boukelmoune
On Mon, Apr 17, 2023 at 4:17 PM Guillaume Quintard wrote: > > That code hasn't moved in a while, so I'd be surprised to see a bug there, > but that's always possible. > Any chance you could get a tcpdump of a probe request (from connection to > disconnection) so we can see what's going on? It

Re: CLI result = 300, how to troubleshoot?

2023-02-15 Thread Dridi Boukelmoune
On Wed, Feb 15, 2023 at 10:24 AM Jakob Bohm wrote: > > Dear fellow users, > > I am running varnish-cache 7.2.1 (compiled from source) in > preproduction. > After some seemingly minor settings changes, every time I > try to start varnishd, I get the following on the terminal: > > #

Re: varnish:6.0.11 Docker image crashing on Apple M1 processor

2023-01-26 Thread Dridi Boukelmoune
Hi Martynas, On Thu, Jan 26, 2023 at 9:00 PM Martynas Jusevičius wrote: > > Hi Guillaume, > > I reproduced the same error as well, running Terminal in Rosetta on MacOS. > > Can it be a permissions issue if the same exact docker-compose setup > runs fine on Windows? The problem with containers

Re: Header names case sensitivity

2022-12-15 Thread Dridi Boukelmoune
On Wed, Dec 14, 2022 at 10:05 AM Jérémy Lecour wrote: > > On Wed, Dec 14, 2022 at 10:56 AM Poul-Henning Kamp > wrote: > > not everybody reads RFCs recreationally... > > What ?? I'm shocked ! :D > > I spent 2 hours last night reading parts of the RFC9110 about HTTP and I've > learnt a lot about

Re: Varnish 6.0.11 panic help

2022-11-23 Thread Dridi Boukelmoune
On Tue, Nov 22, 2022 at 6:03 PM Luke Rotherfield wrote: > > Hi Guys > > I am really struggling to debug this panic and wondered if you could give any > hints were I might start looking for answers. I have been trawling the > GitHub repo and have seen several people recommend upping the >

Re: HTTP error code in case of workspace overflow

2022-08-25 Thread Dridi Boukelmoune
Hi, On Wed, Aug 24, 2022 at 9:26 AM wrote: > > Hello all, > > I was looking on this Varnish troubleshooting guide, section "Not enough > workspace memory". > There is info that Varnish should return 503 HTTP code when there is overflow: > > When a task consumes more memory than allowed in one

Re: Varnish attempting to serve disconnected clients

2022-07-28 Thread Dridi Boukelmoune
On Thu, Jul 28, 2022 at 12:07 PM Lee Hambley wrote: > > Dear List, > > I'm debugging a problem with our Varnish, and our QA folks found an > interesting case. > > Ultimately this breadcrumb trail was discovered looking into our varnishes > having an enormous number of open connections in

Re: How to handle errors when using esi tags?

2022-07-13 Thread Dridi Boukelmoune
On Tue, Jul 12, 2022 at 9:50 PM Felipe Santiago wrote: > > Hi, > > I've been trying to use to execute a > subrequest to /bar in case /foo fails, however I didn't manage to make it > work. Do you support the alt attribute? If my backend returns a 4xx or 5xx, > is that considered an error? Hi,

Re: health check varnish

2021-12-30 Thread Dridi Boukelmoune
On Thu, Dec 30, 2021 at 8:17 AM Johan Hendriks wrote: > > Hello all, first off all, thanks for a year full of varnish happiness > like the developers page and the parallel ESI for the varnish-cache edition. > > We use the following in the vcl for our varnish health check from our > haproxy

Re: Varnish returning synthetic 500 error even though it has stale content it should serve. But only seems to happen during/after a burst of traffic

2021-12-20 Thread Dridi Boukelmoune
On Fri, Dec 17, 2021 at 4:03 PM Marco Dickert - evolver group wrote: > > On 2021-12-17 15:25:31, Batanun B wrote: > > Thanks. I have thought about that too. But I think we might want to include > > non-error transactions as well. I mean, with the problems this post is about > > we want to see

Re: Best practice for caching scenario with different backend servers but same content

2021-10-06 Thread Dridi Boukelmoune
On Mon, Aug 16, 2021 at 1:34 PM Hamidreza Hosseini wrote: > > > In that case, hashing the URL only would prevent you from adding new > domains through your Varnish server. It won't hurt if you know you > will only ever have one domain to deal with, but hashing the host will > also not hurt as

Re: Difference between adjusting set req backend in vcl_recv and vcl_backend_fetch

2021-10-05 Thread Dridi Boukelmoune
On Mon, Sep 6, 2021 at 2:22 PM Hamidreza Hosseini wrote: > > Hi, > This is part of my varnish configuration file for sharding: > > ``` > cat /etc/varnish/default.vcl > > vcl 4.1; > > import directors; > > > probe myprobe { > .request = > "HEAD /healthcheck.php HTTP/1.1" >

Re: Varnish only resolve the ip on startup

2021-10-04 Thread Dridi Boukelmoune
On Mon, Oct 4, 2021 at 5:15 PM Guillaume Quintard wrote: > > On Mon, Oct 4, 2021 at 9:49 AM Dridi Boukelmoune wrote: >> >> One problem I have (and that you should be familiar with) is that >> portable interfaces we have that *respect* the system configuration

Re: Varnish only resolve the ip on startup

2021-10-04 Thread Dridi Boukelmoune
On Mon, Oct 4, 2021 at 5:29 PM Justin Lloyd wrote: > > I’m definitely watching this topic, considering I’m planning on moving to > Varnish Enterprise next year and putting a cluster in ECS, if not Fargate, so > being able to easily handle dynamic IPs would be extremely helpful. Like I implied

Re: Varnish only resolve the ip on startup

2021-10-04 Thread Dridi Boukelmoune
On Mon, Oct 4, 2021 at 3:45 PM Guillaume Quintard wrote: > > I think it makes sense for Varnish to natively support backends changing > their IPs. I do get the performance argument but now that there is a > cloud/container market and that Varnish has proven to be useful in it, this > basic

Re: varnishadm exit code 200

2021-10-03 Thread Dridi Boukelmoune
On Sat, Oct 2, 2021 at 10:24 PM Martynas Jusevičius wrote: > > Actually it does not seem to be the exit code. I tried checking and it > looks like the exit code is 0: > > root@dc17c642d39a:/etc/varnish# varnishadm "ban req.url ~ /" > 200 > > root@dc17c642d39a:/etc/varnish# test $? -eq 0 || echo

Re: Serve stale content if backend is healthy but "not too healthy"

2021-09-21 Thread Dridi Boukelmoune
On Tue, Sep 21, 2021 at 1:33 PM Luca Gervasi wrote: > > Hello everyone, > > We have a backend that actually proxies different services (mangling > the original response). Sometimes one of those backends are not > available and the general response goes from 200 to a 50x. > Is there a way to serve

Re: Varnish Cache Runaway RAM Usage!

2021-09-07 Thread Dridi Boukelmoune
On Tue, Sep 7, 2021 at 3:14 PM John Kormanec wrote: > > Hello, > > We have been using the open source (free) version of Varnish Cache for my > company's website for several months but are repeatedly running into an issue > where Varnish's memory usage increases until all of the server's

Re: Best practice for caching scenario with different backend servers but same content

2021-08-15 Thread Dridi Boukelmoune
On Sat, Aug 14, 2021 at 10:54 AM Hamidreza Hosseini wrote: > > Hi, > Thanks to you and all varnish team for such answers that helped me alot, > I read the default varnish cache configuration again: > https://github.com/varnishcache/varnish-cache/blob/6.0/bin/varnishd/builtin.vcl > and find out

Re: Upgrading to 6.6 can't reload

2021-08-02 Thread Dridi Boukelmoune
>> Can you try removing the -S option from varnishd? >> >> Since you only listen to the CLI on localhost, there's likely no >> remote access, so leaving the secret out will make varnishd generate a >> random one. Basically, if you want to use varnishadm you need local >> root privileges, same as

Re: Creating ACLs in Varnish

2021-08-02 Thread Dridi Boukelmoune
> Is there a better approach to this in Varnish Cache? We’re also going to be > evaluating Varnish Enterprise, so if there’s something in VE, that would also > be good to know. Hello, There are better ways to do this, but not out of the box with Varnish Cache. You would need something like

Re: Upgrading to 6.6 can't reload

2021-06-21 Thread Dridi Boukelmoune
On Mon, Jun 21, 2021 at 6:45 AM Richard Chivers wrote: > > Hi, thanks for coming back. No, the hostname didn't change. Here is the rest > of the file: > > [Unit] > -S /etc/varnish/secret \ Can you try removing the -S option from varnishd? Since you only listen

Re: Understanding 503s

2021-04-15 Thread Dridi Boukelmoune
Hello, For global timeouts: https://varnish-cache.org/docs/trunk/reference/varnishd.html#run-time-parameters They contain "timeout" in the name. For VCL-defined timeouts: https://varnish-cache.org/docs/trunk/reference/vcl-backend.html#timeout-attributes

Re: Cookie VMOD keep/filter documentation issue

2021-04-06 Thread Dridi Boukelmoune
On Tue, Apr 6, 2021 at 5:41 PM Justin Lloyd wrote: > > Forget I asked, that was a dumb question since it's a regex and | can be > used. /sigh Yes, "|" is an option. > Hi Dridi, > > Thanks for confirming that! However, is there then a way to get the effect of > being able to pass a regex to

Re: Cookie VMOD keep/filter documentation issue

2021-04-06 Thread Dridi Boukelmoune
On Tue, Apr 6, 2021 at 4:11 PM Justin Lloyd wrote: > > Hi all, > > I'm confused on whether cookie.keep_re and cookie.filter_re should work with > CSV strings. The documentation at > https://varnish-cache.org/docs/trunk/reference/vmod_cookie.html does not > explicitly say that those two

Re: Varnish cache MISS

2021-03-10 Thread Dridi Boukelmoune
On Wed, Mar 10, 2021 at 9:09 PM Martynas Jusevičius wrote: > > Nevermind :) I realized the URLs in this log are truncated and the > first one contains a unique ID in it... You might also want to pay attention to backend response headers: - RespHeader Cache-Control: private If this

Re: Download paths of varnish.tgz include random string

2021-02-15 Thread Dridi Boukelmoune
On Mon, Feb 15, 2021 at 9:12 AM Marco Lechner wrote: > > Hallo, > > since a while a varnish Release is not available on a clear-url basis like > http://varnish-cache.org/_downloads/varnish-6.0.5.tgz > with just the release verison as mutable , but has a generated random string > as part o the

Re: Traffic drop issue

2020-11-02 Thread Dridi Boukelmoune
On Mon, Nov 2, 2020 at 3:59 PM Guillaume Quintard wrote: > > What intrigues me is why the number of requests decreased. Hitting > thread_pool_max should make the number of request plateau, not go down. > > If there's a loadbalancer that realizes requests are getting dropped, and so > takes

Re: Traffic drop issue

2020-11-02 Thread Dridi Boukelmoune
> > Did you try to increase thread_pool_max? > > > > Yes, we increased thread_pool_max and thread_pool_min after that issue. > For the moment all work fine. FWIW, it's in the documentation of the threads_limited counter, which you (and Guillaume) didn't seem to notice (or remember) before I

Re: Traffic drop issue

2020-10-29 Thread Dridi Boukelmoune
On Thu, Oct 29, 2020 at 3:06 PM Sébastien EISSLER wrote: > > Hello, > > Yes, we have a load-balancer in front, we already investigate that way and > don't dectect any error or configuration limitation. > The fact that threads_limited counter strongly increase and that restart of > Varnish

Re: Modifying req.url and restart() produces ncsa to log wrong URL resource

2020-10-01 Thread Dridi Boukelmoune
On Tue, Sep 29, 2020 at 8:10 PM Marian Velez wrote: > > Hiya all! > > I've been trying to implement an abtest engine on my varnish. The problem > I've come across is related to the manipulation of the original req.url > property. > > What I'm experiencing is that when setting a new "req.url"

Re: Question regarding vcl config

2020-09-27 Thread Dridi Boukelmoune
On Sat, Sep 26, 2020 at 8:31 PM Johan Hendriks wrote: > > Thank you very much for your quick responce, so the order of the rules matter > when you write vcl? > I didn't know that, but it makes sense. Yes, VCL is an imperative programming language and statements are executed in order. > I start

Re: Question regarding vcl config

2020-09-26 Thread Dridi Boukelmoune
On Sat, Sep 26, 2020 at 4:41 PM Johan Hendriks wrote: > > Hello all, I have inherited a varnish server. And I am a little confused > about a few lines in that config. > > It has the following in vcl_recv > > # Don't cache if there are request cookies > if (req.http.Cookie) { >

Re: Can't get "streaming" or pipe to work, Varnish still waits for the full response

2020-09-14 Thread Dridi Boukelmoune
On Sat, Sep 12, 2020 at 10:08 PM Batanun B wrote: > > Hi, > > We have some old (legacy) internal admin pages that do some classic old > school processing while the page is loading, and outputting the current > status as it is working. When requesting these pages directly (through > Tomcat), I

Re: Possible to detect a previous xkey softpurge?

2020-09-14 Thread Dridi Boukelmoune
On Sat, Sep 12, 2020 at 9:56 PM Batanun B wrote: > > > Arguably, if you use Varnish to cache responses, you might as well > > always tell your backend not to serve from cache. Because if a soft > > purge moves you inside the grace period, there's no guarantee that the > > next hit will happen

Re: Possible to detect a previous xkey softpurge?

2020-09-03 Thread Dridi Boukelmoune
On Thu, Sep 3, 2020 at 10:57 AM Batanun B wrote: > > Hi, > > We sometimes have a problem with the backend using its internal cache for a > few seconds too long after something has been updated. We trigger a softpurge > (xkey vmod) in varnish, but if someone requests the page again very soon >

Re: Using user defined variable in backend definition?

2020-08-25 Thread Dridi Boukelmoune
On Tue, Aug 25, 2020 at 9:20 AM Batanun B wrote: > > On Mon, Aug 24, 2020 at 11:07 PM Dridi Boukelmoune wrote: > > > Hi, > > > > You can't do that, but you can move the backend definition inside > > environment.vcl instead to keep your default.vcl the same ac

Re: Error in varnish child

2020-08-03 Thread Dridi Boukelmoune
On Mon, Aug 3, 2020 at 11:28 AM hamidreza hosseini wrote: > > Hi > I have this error on my varnish instance , is this important or i can ignore > it?: No, you should promptly do something about it. First off, Varnish 4.1 is no longer supported. You should be able to update to 4.1.10 without a

Re: Detect request coalescing?

2020-07-30 Thread Dridi Boukelmoune
On Thu, Jul 30, 2020 at 7:30 PM Batanun B wrote: > > Just a quick question that I wasn't able to find any information on using > regular google searches. Is it possible to detect request coalescing somehow? > Meaning that, when looking at the response headers, can I somehow see that > the

Re: VSM: Could not get hold of varnishd, is it running?

2020-07-20 Thread Dridi Boukelmoune
On Mon, Jul 20, 2020 at 8:12 AM Meken wrote: > > Sorry! > > root@hosting:/var/lib/varnish# hostname > hosting So now the problem is that you removed the /var/lib/varnish/support directory and we lost the opportunity to inspect it ¯\_(ツ)_/¯ Does the PID in /var/lib/varnish/hosting/_.pid match

Re: VSM: Could not get hold of varnishd, is it running?

2020-07-20 Thread Dridi Boukelmoune
> So I rm -r /var/lib/varnish/support (it is wrong hostname), but nothing > changed? You didn't share the output of the hostname command. Dridi ___ varnish-misc mailing list varnish-misc@varnish-cache.org

Re: VSM: Could not get hold of varnishd, is it running?

2020-07-20 Thread Dridi Boukelmoune
On Sat, Jul 18, 2020 at 8:50 PM Meken wrote: > > I am running Ubuntu 20.04. > > Recently upgrade of bash (apt update && apt upgrade) causes > varnishlog/varnishtop/varnishtop not working: > http://us.archive.ubuntu.com/ubuntu focal-updates/main amd64 bash amd64 > 5.0-6ubuntu1.1 > > varnishstat

Re: solution for Active/Passive Backend

2020-07-04 Thread Dridi Boukelmoune
On Sat, Jul 4, 2020 at 3:54 PM Guillaume Quintard wrote: > > Hi, > > You will have to define a probe, otherwise Varnish will consider the backend > to be healthy by default. You would then be able to manually make it sick, > but for automatic health, you need probing. Alternatively one can

Re: Caching OSM tiles - how to not overload backends?

2020-06-15 Thread Dridi Boukelmoune
On Sun, Jun 14, 2020 at 2:32 AM tranxene50 wrote: > > Hello! > > Please forgive my bad English, I live in France. > > Summary: how to cache - with Varnish - Open Street Map PNG images without > overloading OSM tiles servers? > > The question seems related to Varnish backends and

Re: varnish node without gcc

2020-06-15 Thread Dridi Boukelmoune
On Mon, Jun 15, 2020 at 12:29 PM wrote: > > Hi, > > is it possible to compile the final merged vcl configuration in a pre > step and then pushing it to the frontend nodes? So, no vcl config and > gcc on the frontend. Just a bin blob and a restart of the service. It is technically possible to

Re: vmod_header (varnish-modules) on varnish cache 4.1

2020-05-25 Thread Dridi Boukelmoune
On Mon, May 25, 2020 at 1:19 PM Vlad Rusu wrote: > > Hi all, > > A question for the maintainers of https://github.com/varnish/varnish-modules > > I need to use vmod_header to get control over the Set-Cookie response > headers. Feels like there is no other way in Varnish Cache. > > Looking at the

Re: Transparent hugepages on RHEL8

2020-05-25 Thread Dridi Boukelmoune
> are the implications that varnish build that way in this context > is more resilient with hugepages enabled? I have no idea, we didn't package the el8 varnish DNF module! ___ varnish-misc mailing list varnish-misc@varnish-cache.org

Re: Transparent hugepages on RHEL8

2020-05-25 Thread Dridi Boukelmoune
On Sun, May 24, 2020 at 8:12 AM Geoff Simmons wrote: > > On 5/24/20 01:29, info+varn...@shee.org wrote: > > This notes > > > > https://varnish-cache.org/docs/trunk/installation/platformnotes.html > > > > has a comment about "Transparent hugepages". > > > > Does this still apply to EL8? > > That's

Re: Varnish over memory allocation

2020-05-25 Thread Dridi Boukelmoune
On Mon, May 25, 2020 at 8:07 AM Alex Wakefield wrote: > > Whoops, knew I forgot to specify something! > > We're using malloc. Command line switch is specifically `-s malloc,24GB` The -s option only specifies the storage size (HTTP responses with some metadata). The rest of Varnish's memory

Re: Detecting and fixing VSV00004 in older releases

2020-05-13 Thread Dridi Boukelmoune
> I tried to reproduce it myself today and I wasn't able to trigger the > leak on the master branch's commit prior to the fix. I asked > internally whether we have a reliable reproducer or if it's something > that needs a consequential workload to be observable. The step I was missing trying to

Re: Detecting and fixing VSV00004 in older releases

2020-05-12 Thread Dridi Boukelmoune
Hello Sylvain, > >> Do we know in what version Trygve Tønnesland triggered the vulnerability? It was first discovered on Varnish Enterprise, and once the origin of the leak was identified we surveyed older and newer releases and fixed the ones listed in the advisory. > > To put it

Re: Detecting and fixing VSV00004 in older releases

2020-04-22 Thread Dridi Boukelmoune
Bonjour Sylvain, On Sat, Apr 18, 2020 at 7:18 PM Sylvain Beucler wrote: > > Hi, > > I'm part of the Debian LTS (Long Term Support) team, I'm checking what > Debian varnish packages are affected by CVE-2019-20637, and how to fix them. > > In particular, we ship 4.0.2 and 5.0.0, where

Re: Installation of Varnish 6.0LTS on Debian Buster

2020-04-02 Thread Dridi Boukelmoune
On Thu, Apr 2, 2020 at 8:36 AM Kristian Grønfeldt Sørensen wrote: > > Hi, > > It doesn't look like there's any Varnish 6.0LTS on packagecloud. Is > there any plans for when they will be available, or is it just me who > can't find them? > > Additionally I noticed that the link to >

Re: Varnish not respecting pass to backend for specified http hosts

2020-03-31 Thread Dridi Boukelmoune
On Tue, Mar 31, 2020 at 9:58 PM Guillaume Quintard wrote: > > Hi, > > I think there is a bit of confusion regarding what "return(pass)" does. > > Basically, when a request comes in, you need to answer two questions: > - do I want to cache it? > - if I need data from the backend, well, what is my

Re: Grace and misbehaving servers

2020-03-25 Thread Dridi Boukelmoune
> > A problem with the restart logic is the race it opens since you now > > have two lookups, but overall, that's the kind of convoluted VCL that > > should work. The devil might be in the details. > > Could you describe this race condition that you mean can happen? What could > the worst case

Re: Grace and misbehaving servers

2020-03-23 Thread Dridi Boukelmoune
Hi, On Fri, Mar 20, 2020 at 10:14 PM Batanun B wrote: > > On Thu , Mar 19, 2020 at 11:12 AM Dridi Boukelmoune wrote: > > > > Not quite! > > > > ttl+grace+keep defines how long an object may stay in the cache > > (barring any form of invalidati

Re: Purging on PUT and DELETE

2020-03-19 Thread Dridi Boukelmoune
On Thu, Mar 19, 2020 at 10:28 AM Martynas Jusevičius wrote: > > Thank you Dridi. > > But what I'm reading here > https://docs.varnish-software.com/tutorials/cache-invalidation/ > > Unlike purges, banned content won’t immediately be evicted from cache > > freeing up memory, instead it will

Re: Purging on PUT and DELETE

2020-03-19 Thread Dridi Boukelmoune
On Thu, Mar 19, 2020 at 10:05 AM Martynas Jusevičius wrote: > > Hi, > > upon receiving a PUT or DELETE request, I'd like Varnish to invalidate > the current object (and its variants) *and* to pass the request to the > backend. > > Essentially the same question as here: >

Re: Grace and misbehaving servers

2020-03-19 Thread Dridi Boukelmoune
On Tue, Mar 17, 2020 at 8:06 PM Batanun B wrote: > > Hi Dridi, > > On Monday, March 16, 2020 9:58 AM Dridi Boukelmoune wrote: > > > Not really, it's actually the other way around. The beresp.grace > > variable defines how long you may serve an object past its TTL o

Re: Fix incorrect Last-Modified from backend?

2020-03-19 Thread Dridi Boukelmoune
On Wed, Mar 18, 2020 at 2:17 PM Batanun B wrote: > > Hi, > > Long story short, one of our backend systems serves an incorrect > Last-Modified response header, and I don't see a way to fix it at the source > (third party system, not based on Nginx/Tomcat/IIS or anything like that). > > So, I

Re: Grace and misbehaving servers

2020-03-16 Thread Dridi Boukelmoune
Hi, On Sun, Mar 15, 2020 at 9:56 PM J X wrote: > > Hi, > > I'm currently setting up Varnish for a project, and the grace feature > together with health checks/probes seems to be a great savior when working > with servers that might misbehave. But I'm not really sure I understand how > to

Re: Varnishncsa Random Log Sampling ?

2020-03-02 Thread Dridi Boukelmoune
On Mon, Mar 2, 2020 at 11:15 AM Yassine Aouadi wrote: > > > Hello, > > I am sending my Varnish log to to remote SAAS solution I and want to > improve logs costs by implementing a server side sampling solution . > > First I splitted Varnishnncsa into two service one for error logs and the

Re: How to disable core-dump of varnish?

2020-02-10 Thread Dridi Boukelmoune
On Mon, Feb 10, 2020 at 5:02 PM Veeresh Reddy wrote: > > Any idea on how to turn it off except for panic messages? This? varnishadm param.set feature +no_coredump Or during startup: varnishd [...] -p feature=+no_coredump See `man varnishd` for other feature flags. Dridi

Re: Varnish 6.3, Hitch & HTTP/2

2020-02-06 Thread Dridi Boukelmoune
On Thu, Feb 6, 2020 at 9:50 AM Admin Beckspaced wrote: > > Hello Guillaume, > > thanks again for your reply > > ok ... did enable hitch ALPN > > alpn-protos = "http/2, http/1.1" > > did enable http/2 in varnish. > > I'm running opensuse and it has its configuration in /etc/sysnconfig/varnish > >

Re: Running Two varnishncsa Instances using Systemd : looking for best practice

2020-01-30 Thread Dridi Boukelmoune
On Wed, Jan 29, 2020 at 4:59 PM Yassine Aouadi wrote: > > > Dridi, > > Thank you for the Catch ! > > I was going to correct with "RespStatus > 399 or BerespStatus > 399" but > yours is better. Pick whatever works best for you ;-) > Splitting the unitsseems to look fine in Dev : > > --- > ●

Re: Running Two varnishncsa Instances using Systemd : looking for best practice

2020-01-29 Thread Dridi Boukelmoune
Hi, On Wed, Jan 29, 2020 at 3:09 PM Yassine Aouadi wrote: > > Hello , > > I Would like to Split my Varnish logs into access log and error log file : > > I Know I can reach my goal by command line using varnishncsa : > > --- > usr/bin/varnishncsa -c -b -a -w

Re: How to discover manager & worker PIDs given a Varnish Cache instance name?

2019-12-18 Thread Dridi Boukelmoune
Hello Carlos, On Wed, Dec 18, 2019 at 4:04 PM Carlos Abalde wrote: > > Hi, > > Simple question related with Varnish Cache and monitoring. Let's assume a > single server running one or more Varnish Cache instances. Given the name of > one instance (i.e. '-n' argument), is there any reasonable

Re: Caching a resource after specific number of requests

2019-12-05 Thread Dridi Boukelmoune
On Tue, Dec 3, 2019 at 6:04 PM al sefid wrote: > > Hello there! > Is there any functionality like proxy_cache_min_uses in the Varnish cache > that caches a resource after specific number of requests to that resource? > Thank you! Varnish is not capable of doing that by itself, but as Geoff

Re: unset X-Varnish header to the backend server but keep it in the response to client

2019-11-08 Thread Dridi Boukelmoune
Hi, Thank you for taking the time to reach out to this list. On Fri, Nov 8, 2019 at 8:39 AM EC DIGIT FPFIS wrote: > > Dear all, > > Currently, I migrate a configuration from Varnish 3 to Varnish 6 but I have > an issue concerning unset a header to a backend but keep it in the resp. > > Indeed,

Re: Conditional Logging ( using varnishncsa )

2019-11-06 Thread Dridi Boukelmoune
On Thu, Nov 7, 2019 at 6:34 AM Maninder Singh wrote: > > Hi, > > We have logging turned on using varnishncsa. > > /usr/bin/varnishncsa -a -w /var/log/varnish/varnishncsa.log -D -f > /etc/sysconfig/varnishncsa > > Here is what's defined in varnishncsa > > %{X-Forwarded-For}i %l %u %t %D \"%r\" %s

Re: Affected 5.x versions of VSV00004 Workspace information leak

2019-10-23 Thread Dridi Boukelmoune
On Wed, Oct 23, 2019 at 9:38 AM Erik Wasser wrote: > > Hello list, > > sometimes I'm confused about the supported versions of Varnish. This > resulted in the post "LTS time frame for Varnish 6.0.X?" on > https://varnish-cache.org/lists/pipermail/varnish-dist/2019-September/000173.html. > > But

Re: Varnish version 6.3 vcl test fails with custom http header starting with a number

2019-10-21 Thread Dridi Boukelmoune
> before submitting a bug a report in github wanted to check is someone is > familiar with this issue ? Can you tell us from which version you are upgrading to 6.3? I know that at some point header names parsing changed so that they'd have to be proper VCL symbols, leaving no room for otherwise

Re: How to send only whitelisted http headers to backend?

2019-10-18 Thread Dridi Boukelmoune
On Thu, Oct 17, 2019 at 12:50 PM Jeff Potter wrote: > > > Thanks, Geoff and Dridi! We’ll give this a try. > > And Dridi, thanks also for maintaining varnish and this list — “long time > lurker; very rare poster” — since I have the microphone, just wanted to send > a short note of appreciation.

Re: How to send only whitelisted http headers to backend?

2019-10-16 Thread Dridi Boukelmoune
On Wed, Oct 16, 2019 at 4:08 PM Geoff Simmons wrote: > > On 10/15/19 16:21, Jeff Potter wrote: > > > > This seems like an easy task, but I haven’t been able to figure out > > how to do it or find any posts online. Is there a way to only send > > certain headers to a backend? > > > > I.e. in our

Re: How to send only whitelisted http headers to backend?

2019-10-15 Thread Dridi Boukelmoune
On Tue, Oct 15, 2019 at 2:22 PM Jeff Potter wrote: > > > Hi All, > > This seems like an easy task, but I haven’t been able to figure out how to do > it or find any posts online. Is there a way to only send certain headers to a > backend? > > I.e. in our application, we know we only need

Re: Migration from 4.1 vcl

2019-10-09 Thread Dridi Boukelmoune
> > Probably mostly third-party VMODs, since Varnish 6.x still supports > > the VCL 4.0 syntax. > > Any specific info on migration of vmods? > I mostly use the "bundled" vmods[1], but occasionally others like > libvmod-sqlite3[2]. > > If I wanted to convert or upgrade them, do you have any hints

Re: Migration from 4.1 vcl

2019-10-09 Thread Dridi Boukelmoune
On Wed, Oct 9, 2019 at 9:27 AM Miguel Gonzalez wrote: > > Hi, > > I am migrating from 4.1 and I am scared that with latest version varnish > would break. > > What should I take into account when migrating from 4.1? Probably mostly third-party VMODs, since Varnish 6.x still supports the VCL 4.0

Re: Varnish and failed upstream

2019-07-10 Thread Dridi Boukelmoune
On Tue, Jul 9, 2019 at 8:12 AM Nikolay Bogdanov wrote: > > Hello. I have one case and I can not find good solution for it. > In varnish3 req.backend was saved during restarts, so I can compare old > backend property and set other backend after first restart. > But in varnish 5 and newer

Re: Varnish hit + pass + miss reaches less than 50% of all reqs

2019-04-18 Thread Dridi Boukelmoune
On Wed, Apr 17, 2019 at 6:23 PM Guillaume Quintard wrote: > > Hi there, > > So: > > MAIN.client_req290152364 (aaall the requests) > > vs > > MAIN.cache_hit 7433491 > MAIN.cache_hit_grace36319 (exclude these are they are already > accounted for in MAIN.cache_hit)

Re: Varnish removing tags incorrectly fromURL

2019-03-29 Thread Dridi Boukelmoune
On Fri, Mar 29, 2019 at 8:18 AM wrote: > > Hi, > > It was just my mistake, you must download the tar.gz version from releases > tab : https://github.com/Dridi/libvmod-querystring/releases I would have been surprised if a 1.x release didn't work for you :) Thanks for confirming and don't

Re: Varnish removing tags incorrectly fromURL

2019-03-27 Thread Dridi Boukelmoune
On Wed, Mar 27, 2019 at 2:33 PM wrote: > > Hello, > > > >I would highly appreciate if I get some help on the following issu: If you need to filter out or extract parameters from a query-string I recommend this: https://github.com/Dridi/libvmod-querystring/#vmod-querystring If you are

Re: reg: not getting ReqAcct tag in varnishlog

2019-03-20 Thread Dridi Boukelmoune
On Wed, Mar 20, 2019 at 10:40 AM Hardik wrote: > > Hi Dridi, > > Do you need all timestamps or a specific metric? > Regarding timestamp, want to read two tags, > Timestamp Start: 1516269224.184112 0.00 0.00 > Timestamp Resp: 1516269224.184920 0.000808 0.87 > > Do you need

Re: reg: not getting ReqAcct tag in varnishlog

2019-03-19 Thread Dridi Boukelmoune
Hi, Thank you for the details, more questions to come. On Tue, Mar 19, 2019 at 1:42 AM Hardik wrote: > > Hi Dridi, > > Can you give me a list of log records you need to collect? > > SLT_Timestamp : Do you need all timestamps or a specific metric? > SLT_ReqStart : > SLT_ReqMethod : >

Re: reg: not getting ReqAcct tag in varnishlog

2019-03-18 Thread Dridi Boukelmoune
On Mon, Mar 18, 2019 at 5:53 PM Hardik wrote: > > Hi Dridi, > > I am reading few tags for Billing purpose. I have added VMOD for this.In vmod > currently I was passing "-g session" option to varnish callback function. But > I found out that not getting ReqAcct tag. Also I am missing lots of

Re: reg: not getting ReqAcct tag in varnishlog

2019-03-18 Thread Dridi Boukelmoune
On Sun, Mar 17, 2019 at 1:12 PM Hardik wrote: > > Thanks a lot Dridi & Team for details.. Before I can answer your questions, can you explain exactly what you are trying to do? We could probably give you better advice if we knew what you need to collect. Dridi

Re: reg: not getting ReqAcct tag in varnishlog

2019-03-13 Thread Dridi Boukelmoune
On Wed, Mar 13, 2019 at 3:56 PM Hardik wrote: > > Hi Dridi, > > We should able to recreate with load and mobile requests. I have not tried > with 6.0.3. I guess there's no need for that. Your varnishlog setup is stretched too thin to cope with your load. I was completely oblivious to the

Re: ESI slowing down page loading

2019-03-12 Thread Dridi Boukelmoune
Hi Pinakee, On Tue, Mar 12, 2019 at 12:41 PM Pinakee BIswas wrote: > > Hi Dridi, > > Thanks for your response and the details. > > I did get the info on PESI from someone from the varnish plus team. > > Would certainly look into it but being a young company, would have also > factor in the cost

Re: reg: not getting ReqAcct tag in varnishlog

2019-03-12 Thread Dridi Boukelmoune
On Tue, Mar 12, 2019 at 11:54 AM Hardik wrote: > > Hi Dridi, > > Varnish version - 6.0.1 > OS - centos 7 > > I checked out vanish 6.0.1 source code, built rpm and installed. > > Please let me know if more information is required. Do you have a reliable way to reproduce this? If so, can you

  1   2   3   4   >