Re: GRSEC and Varnish

2010-02-04 Thread Kristian Lyngstol
On Tue, Feb 02, 2010 at 04:44:48PM +0100, Bernardf FRIT wrote: Hi, I'am running : - varnishd (varnish-2.0.4) Why not 2.0.6? and it appears that the grsec Kernel repeatedly and unexpectedly sends signal 11 to the varnishd child. grsec seems to just report that a segfault occurred. SIGSEG

Re: Cache utilization?

2010-01-25 Thread Kristian Lyngstol
On Wed, Nov 18, 2009 at 01:02:32PM +, Poul-Henning Kamp wrote: In message f066603d-901b-4e4d-ac37-e5890c963...@gyldendal.dk, =?iso-8859-1?Q? Lars_J=F8rgensen?= writes: Hi, Obvious question but I can't find the answer anywhere: How do I know how much of my cache is utilized, i.e. is my

Re: varnishlog not behaving as expected (by me)

2010-01-25 Thread Kristian Lyngstol
On Wed, Jan 13, 2010 at 11:24:07AM +, Alex Hooper wrote: I'm having a bit of trouble using varnishlog. I am using: /usr/local/bin/varnishlog -o RxURL ^wp-admin$ All your urls start with /, so that will never match. Try ^/wp-admin and you should have better luck. (...)

Re: vim syntax

2010-01-22 Thread Kristian Lyngstol
On Tue, Nov 24, 2009 at 07:57:54PM +0200, Elan Ruusamäe wrote: @phk mentioned in the irc, that somebody has written varnish syntax for vim. i tried to search the archives but found no info about it. anyone knows? would be pity to start writing one from scratch if somebody already spend

Re: Strange different behavior

2010-01-14 Thread Kristian Lyngstol
On Wed, Jan 13, 2010 at 06:45:26PM +0100, Bernardf FRIT wrote: Hi, I'm facing a pretty strange issue. URLs not supposed to be cached are in cache when requested by firefox but not by lwp. (...) Vary: Accept-Encoding,User-Agent This is why. Vary: means this page will look different

Re: Strange 302 redirect to google.com

2010-01-13 Thread Kristian Lyngstol
On Mon, Jan 11, 2010 at 01:57:27PM +0200, Maurice wrote: i have a problem with a strange 302 redirect to google.(com|ro) just by visiting http://dir.acasa.ro on google chrome and ie, on firefox everything works fine. the strange part is that on certain ips (not listed in the vcl so nothing

Re: Saint mode

2009-12-02 Thread Kristian Lyngstol
Hi Anders, On Wed, Nov 18, 2009 at 02:52:39PM +0100, Anders Nordby wrote: We spoke briefly about in the Varnish meeting. Unfortunately I can not remember the conclusion(s), so I ask again: 1) How to check in vcl_recv if a request was restarted saintmode? You mentioned something about

Benchmarking and stress testing Varnish

2009-11-13 Thread Kristian Lyngstol
As some of you might already know, I regular stress tests of Varnish, most of the time it's a matter of testing the same thing over and over to ensure that there aren't any huge surprises during the development of Varnish (we run nightly builds and stress tests of trunk - they need to be as

Re: Varnish stuck on stresstest/approved by real traffic

2009-11-04 Thread Kristian Lyngstol
(Excessive trimming ahead. Whoohoo) On Tue, Nov 03, 2009 at 11:51:22AM +0100, Václav Bílek wrote: When testing varnish throughput and scalability I have found strange varnish behavior. What's the cpu load at that point? Also: use sess_linger. No session_linger == kaboom when things get too

Re: rewrite redirects

2009-10-21 Thread Kristian Lyngstol
On Fri, Aug 21, 2009 at 03:52:12PM +0200, Guenter Wildmann wrote: Hello! Can varnish rewrite redirects from the backend (equivalent to ProxyPassReverse in apache)? If so, how is it done? Assuming the redirects are 302/301s; yes. Check for them in vcl_fetch, then do the magic there, but you

Re: Varnish virtual memory usage

2009-10-21 Thread Kristian Lyngstol
On Mon, Sep 21, 2009 at 02:55:07PM +0300, Roi Avinoam wrote: At Metacafe we're testing the integration with Varnish, and I was tasked with benchmarking our Varnish setup. I intentionally over-flooded the server with requests, in an attempt to see how the system will behave under extensive

Re: Varnish virtual memory usage

2009-10-21 Thread Kristian Lyngstol
On Wed, Oct 21, 2009 at 03:07:00PM +0200, Roi Avinoam wrote: Thanks for your reply. 1. What I did was create 100 simultaneous processes, and each process requested the same page (with 'curl'): a. Once with the exact same URL - which resulted in a 99.9% hit-ratio and VERY high

Restructuring the Wiki

2009-09-24 Thread Kristian Lyngstol
As we talked about during the VUG meeting, the Wiki could use some love. Unless anyone has any strong objections, I'll restructure it shortly. I'll probably rewrite, rename and add a considerable amount of information, so I apologize in advance for the inconvenience. I hope to avoid removing data

Re: Varnish User Group Meeting 2009-09

2009-09-20 Thread Kristian Lyngstol
On Fri, Aug 07, 2009 at 12:08:38PM +0200, Tollef Fog Heen wrote: On September 21st and 22nd, the first Varnish User Group meeting will be held, in Canonical Ltd's offices in Millbank Tower, London, UK. Please see http://varnish.projects.linpro.no/wiki/200909UserGroupMeeting A little update,

Re: travel: eurobsdcon2009 and vug1

2009-09-17 Thread Kristian Lyngstol
On Thu, Sep 17, 2009 at 09:10:21AM +0200, Eivind Bengtsson wrote: What is the exact address (Millbank tower - yes but which floor/company :-)) Which hotel are you guys staying at ? (can you recommend) I can't answer for everyone, but I'm staying at Best Western Corona Hotel. I believe Tollef is

Re: trunk and obj.ttl obj.grace obj.http.set-cookie

2009-09-17 Thread Kristian Lyngstol
On Thu, Sep 17, 2009 at 05:02:37PM +0200, Václav Bílek wrote: I have tried trunk releas and hit problem vith VLC which worked in 2.0.4... Variable 'obj.grace' not accessible in method 'vcl_fetch' Variable 'obj.http.set-cookie' not accessible in method 'vcl_fetch' Variable 'obj.ttl' not

Re: #551: Varnish Crash: Missing errorhandling code in HSH_Prepare(), cache_hash.c line 188

2009-09-16 Thread Kristian Lyngstol
On Wed, Sep 16, 2009 at 09:54:25AM -0700, Ken Brownfield wrote: Ah, I stand corrected. But I was definitely having random crashes when I enabled the vcl_fetch() section below: (...) I'm a bit loathe to reenable this to get a full stacktrace and gdb output, but if there's really nothing

Re: Content-Range header problem

2009-09-16 Thread Kristian Lyngstol
Hi, On Wed, Sep 16, 2009 at 01:16:20PM -0400, Nathan Kinkade wrote: For some reason Varnish (2.0.4) doesn't seem to be respecting the Content-Range header, so our users are unable to resume large downloads that somehow got interrupted. Is this expected and normal behavior, or should this

Re: Content-Range header problem

2009-09-16 Thread Kristian Lyngstol
On Wed, Sep 16, 2009 at 01:36:00PM -0400, Nathan Kinkade wrote: Thanks. The resolution is simple, but I just wanted to be sure. Always nice to verify :) By the way, I just read the labs.cc.o post [1] from when you started using Varnish and I'm curious as to how you're doing now with regards to

Re: obj.ttl derived?

2009-09-14 Thread Kristian Lyngstol
On Mon, Sep 14, 2009 at 12:43:20PM -0700, David Birdsong wrote: On Mon, Sep 14, 2009 at 12:38 PM, David Birdsong david.birds...@gmail.com wrote: awesome, thanks.  this explains poor cache-hit ratio. On Mon, Sep 14, 2009 at 12:22 PM, Kristian Lyngstol krist...@redpill-linpro.com wrote

Re: obj.ttl derived?

2009-09-14 Thread Kristian Lyngstol
On Mon, Sep 14, 2009 at 12:52:15PM -0700, David Birdsong wrote: (snip snip) But are you sure you're getting hits at all? varnistat shows hitrate around .54 for 10 and 1000 second averages. N expired objects is anywhere between 10-40 second though and varnishd has only been running for

Re: returning expired data

2009-09-10 Thread Kristian Lyngstol
On Thu, Sep 10, 2009 at 09:04:07AM +0200, Václav Bílek wrote: Do not know if it is related but this sometime apears in the log: Not likely to be related, no. varnishd[12160]: Child (12161) died signal=6 varnishd[12160]: Child (12161) Panic message: Assert error in Tcheck(), cache.h line

Re: Child Died

2009-09-07 Thread Kristian Lyngstol
On Wed, Sep 02, 2009 at 10:12:00AM -0400, maillis...@gmail.com wrote: I just started my first instance of varnish in production. Within 12 hours, there were alerts from our monitoring system that Varnish was taking 90% of the cpu. Right after that, I find these messages in /var/log/messages,

Re: cant get restart; to fetch and deliver from other backend on HTTP error

2009-09-04 Thread Kristian Lyngstol
On Thu, Sep 03, 2009 at 03:25:32PM +0200, Gerald Leier wrote: On Thu, 2009-09-03 at 11:00 +0200, Kristian Lyngstol wrote: On Thu, Aug 27, 2009 at 04:29:13PM +0200, Gerald Leier wrote: After setting up 2 servers(one returning the requested page the other returning 500 errors) i tested

Re: cant get restart; to fetch and deliver from other backend on HTTP error

2009-09-03 Thread Kristian Lyngstol
On Thu, Aug 27, 2009 at 04:29:13PM +0200, Gerald Leier wrote: After setting up 2 servers(one returning the requested page the other returning 500 errors) i tested a bit but i have some bug in there i cant get a grip on. after the first node returns a http 500 error varnish continues with

Re: Varnish memory consumption issues?

2009-09-02 Thread Kristian Lyngstol
On Sat, Aug 29, 2009 at 12:09:15AM -0400, pub crawler wrote: Hello, new to Varnish. We have been running Varnish for about 5 days now. So far, excellent product. We have a potential issue and I haven't seen anything like this before. We just restarted Varnish - we have a 1GB cache file

Re: Varnish munin plugin trouble

2009-07-17 Thread Kristian Lyngstol
On Fri, Jul 17, 2009 at 11:04:20AM +0200, Norman Leutner wrote: Thanks for the hint, it's been the PATH... [varnish_*] env.varnishstat /usr/local/bin/varnishstat works fine now. Glad to hear it :) I found a small mistake in your plugin, when using multiple varnish installations on a

New munin plugin (Was: Varnish munin plugin trouble)

2009-07-17 Thread Kristian Lyngstol
On Fri, Jul 17, 2009 at 01:03:07PM +0200, Dag-Erling Smørgrav wrote: Norman Leutner n.leut...@all2e.com writes: [to Kristian Lyngstol] Your're the one who wrote that plugin... I was about to say no, that was me - then I found out that my code had been replaced. Kristian, what was wrong

Re: Varnish munin plugin trouble

2009-07-16 Thread Kristian Lyngstol
On Thu, Jul 16, 2009 at 03:31:01PM -0400, Norman Leutner wrote: Trying manually using munin-run I'm getting the expected results. # munin-run varnish_hit_rate client_req.value 30714 (...) Using the munin telnet interface I get no data... # telnet localhost 4949 Trying 127.0.0.1...

Re: Fwd: varnish 2.0.4 backend errors

2009-07-15 Thread Kristian Lyngstol
On Wed, Jul 15, 2009 at 10:01:08AM +0200, Lazy wrote: (...) setting 500 as min threads didn't make any diference, funny thing is that failed requests are in logged in apache as succesful Sorry if I didn't make myself clear: The output from varnishstat didn't indicate that threads was the issue

Re: How many simultanious users

2009-07-15 Thread Kristian Lyngstol
On Wed, Jul 15, 2009 at 11:38:27AM +0200, Lazy wrote: I'm trying to figure out how many simultaneous users a single 8 core machine with local apache running as a backend can handle assumming that all the requests are cached. This is actually very difficult to test, as you often end up with

Re: Fwd: varnish 2.0.4 backend errors

2009-07-15 Thread Kristian Lyngstol
On Wed, Jul 15, 2009 at 12:14:21PM +0200, Lazy wrote: 2009/7/15 Kristian Lyngstol krist...@redpill-linpro.com: You could try to turn on vcl-trace. (-p vcl_trace=on). right now i have something 100-200 req/s won't it kill the server and I can't restart varnish now so I will have try

Re: Question about Cache Purge

2009-07-14 Thread Kristian Lyngstol
On Thu, Jul 09, 2009 at 02:17:35PM -0500, Brian Pan wrote: Hi all, I have a newbie question regarding 'purging the cache.' When I run the following command to purge the root domain of my website, varnishadm -T localhost:80 purge.url ^/$ Are you sure the admin interface is at port 80?

Re: varnish 2.0.4 backend errors

2009-07-14 Thread Kristian Lyngstol
On Tue, Jul 14, 2009 at 11:46:58AM +0200, Lazy wrote: 2009/7/14 Kristian Lyngstol krist...@redpill-linpro.com: 6000 threads is too much. Since it's per pool, it'll cause up to 12 000 threads to start. That's not likely to go over all that well. If you have that sort of traffic, you need

Re: best varnishd config for static files

2009-04-27 Thread Kristian Lyngstol
On Fri, Apr 24, 2009 at 03:28:22PM +0200, Kain Sascha wrote: Thanks a lot for the great Hints. First of all, varnishtop -i TxURL hangs on my system, it shows 3-5 Entries, then freez and uses nearly 100%cpu on one of 8. Have to kill the pid. varnishtop with no args works. Ok, that's not

Re: best varnishd config for static files

2009-04-24 Thread Kristian Lyngstol
On Fri, Apr 24, 2009 at 01:28:36PM +0200, Kain Sascha wrote: /usr/local/sbin/varnishd -a :80 -b 89.250.xx.xx:80 -s malloc,15360M You may want to supply a -w. The default is really whimpy which could create problems during spikes of traffic. Try something like -w 400,800. Varnishstat

Re: Internal redirecition with dynamic backend (fetch 302 and return content)

2009-04-22 Thread Kristian Lyngstol
On Wed, Apr 22, 2009 at 08:41:58AM +0200, Augustin Amann wrote: 1) RP do GET to the backend 2) backend reply a 302 to another server 3) RP do a GET to this new location 4) RP return content and store it. Maybe i can use restart, like [1]. I have no idea where the new location (gived by

Re: multiple domains in one backend 2 varnish servers

2009-04-22 Thread Kristian Lyngstol
On Tue, Apr 21, 2009 at 12:46:15PM +0200, Andreas Kaiser - Atela CC wrote: should be served by Europe server and others by the usa server I think I need to configure each varnish install with a specific vcl config file. Why? They'll be working against the same backend server, and the

Re: Frequent Varnish 2.0.4 Panics

2009-04-20 Thread Kristian Lyngstol
On Fri, Apr 17, 2009 at 02:54:25PM -0700, Igor Minar wrote: Hi there, I see frequent (~every 30 seconds) Varnish panics when running a light load tests on our webapp which is proxied by varnish. What sort of load are you testing with? Has anyone else experienced the same issue? Let me

Re: Cookie handling

2009-04-20 Thread Kristian Lyngstol
On Mon, Apr 20, 2009 at 02:54:33PM +0100, Sam Crawford wrote: The issue arises when we write our custom definitions of vcl_fetch. If we find a static URL we'd do some like remove req.http.cookie and then lookup. However, if the content was not found in memory then it goes to the backend. But

Re: varnish killing off the child process after a few minutes

2009-04-08 Thread Kristian Lyngstol
On Tue, Apr 07, 2009 at 01:01:51PM -0700, Tung Nguyen wrote: Hi guys, We're on varnish 2.0.3 It looks like varnish restarts the child process for us every so often, causing 503s :(. Was wondering if this is a known issue. Can you check the syslog for any more information? -- Kristian

Re: varnish 2.0.4 and new config changes

2009-04-08 Thread Kristian Lyngstol
On Tue, Apr 07, 2009 at 05:29:23PM -0700, Jauder Ho wrote: On Tue, Apr 7, 2009 at 4:46 AM, Kristian Lyngstol krist...@redpill-linpro.com wrote: On Tue, Apr 07, 2009 at 04:11:04AM -0700, Jauder Ho wrote: FYI, beresp.ttl does not work on varnish 2.0.4. It does work on -trunk though

Re: varnish 2.0.4 and new config changes

2009-04-07 Thread Kristian Lyngstol
On Tue, Apr 07, 2009 at 04:11:04AM -0700, Jauder Ho wrote: On Tue, Apr 7, 2009 at 3:19 AM, Kristian Lyngstol krist...@redpill-linpro.com wrote: On Tue, Apr 07, 2009 at 02:55:13AM -0700, Jauder Ho wrote: I just downloaded the new 2.0.4 release and noticed that a couple of things had

Re: varnishd runtime parameters

2009-03-24 Thread Kristian Lyngstol
On Mon, Mar 23, 2009 at 05:58:58PM -0700, Tung Nguyen wrote: Hi guys, So, Im reading over an archive email thread about twitters configuration. http://projects.linpro.no/pipermail/varnish-dev/2009-February/000968.html It looks like they had to adjust a lot of parameters... and Im not