Re: strange restart, taking 15 minutes

2009-03-09 Thread Sascha Ottolski
Am Samstag 07 März 2009 18:52:04 schrieb Sascha Ottolski: I've just seen a strange restart that heppened this morning, after only about 25 h runtime; please ignore the posting, it just came out that the server has a broken hdd. Thanks for listening anyway, Sascha

Re: Panic message: Assert error in exp_timer(), cache_expire.c line 303

2009-02-01 Thread Sascha Ottolski
Am Mittwoch 28 Januar 2009 10:52:47 schrieb Poul-Henning Kamp: In message 200901260917.45223.ottol...@web.de, Sascha Ottolski writes: Assert error in exp_timer(), cache_expire.c line 303: Condition(oe2-timer_when = oe-timer_when) not true. thread = (cache-timeout) [...] It all happens

Re: flushing cache doesn't seem to make varnish know about less

2009-01-11 Thread Sascha Ottolski
Am Montag 12 Januar 2009 05:35:16 schrieb Timothy Ball: a programming error caused varnish to think there were billions of pages it had to know about. bug is quashed but varnish doesn't seem to know # this is a line from top 3596 0.2 28.3g 28g 3808 256 57m 1916 120 S 20 00

uptime not available to nagios plugin?

2008-12-31 Thread Sascha Ottolski
Hi, bug or feature? The nagios plugin seems not to be able to extract the uptime: img-proxy1:~# /usr/local/libexec/check_varnish -p uptime Unknown parameter 'uptime' VARNISH UNKNOWN: (null) (3)|uptime=3 but it probably should, shouldn't it? img-proxy1:~# varnishstat -l 21|grep uptime uptime

next release?

2008-12-21 Thread Sascha Ottolski
Hi folks, I'm curious when the next stable (minor) release is planned. I'm especially interested in Date: 2008-11-14 01:19:33 +0100 (Fri, 14 Nov 2008) New Revision: 3390 Modified: trunk/varnish-cache/lib/libvarnish/binary_heap.c Log: Rework the binary heap, we use for expiry processing, to

varnish 2.0.1 truncates pre-created cache file?

2008-10-20 Thread Sascha Ottolski
Hi, bug or feature? With the new version, my cache file gets shrunk. I made it with dd with a size of ~259 GB, but after starting varnishd, only about 119 GB are left. I don't give a size parameter when starting, as in -s file,/var/cache/varnish/store.bin which worked as expected with

Re: varnish 2.0.1 truncates pre-created cache file?

2008-10-20 Thread Sascha Ottolski
Am Montag 20 Oktober 2008 16:59:37 schrieb Sascha Ottolski: Hi, bug or feature? With the new version, my cache file gets shrunk. I made it with dd with a size of ~259 GB, but after starting varnishd, only about 119 GB are left. I don't give a size parameter when starting, as in -s file

on linux: only one cpu in use?

2008-09-08 Thread Sascha Ottolski
on a 4 core machine, running varnish exclusively, all the I/O goes to one core only: # cat /proc/interrupts CPU0 CPU1 CPU2 CPU3 0: 603869381 0 0 0IO-APIC-edge timer 6: 3 0 0 0IO-APIC-edge

Re: want to allow or deny an URL based on a timestamp

2008-08-13 Thread Sascha Ottolski
Am Mittwoch 13 August 2008 00:02:07 schrieb Darryl Dixon - Winterhouse Consulting: 4) Object expires and Varnish goes to fetch it from the backend, which of course returns 404 or whatever as the URL has expired. Darryl, thanks for your reply. This would of course be a straight forward

Re: Strategy for large cache sets

2008-07-03 Thread Sascha Ottolski
Am Dienstag 01 Juli 2008 20:16:15 schrieb Skye Poier Nott: I want to deploy Varnish with very large cache sizes (200GB or more) for large, long lived file sets. Is it more efficient to use large swap or large mmap in this scenario? According to the FreeBSD lists, even 20GB of swap requires

Re: Performance options for trunk

2008-05-30 Thread Sascha Ottolski
Am Freitag 30 Mai 2008 14:01:35 schrieb Audun Ytterdal: I run trunk in front of a site. I have 3 varnishservers, all with 32GB of ram serving only small pictures, thumbnails and profile pictures. The cacheset is pretty large (1.5 TB) and changing much over time. And before you all ask why I

Re: please help on compiling nagios plugin

2008-05-29 Thread Sascha Ottolski
Am Donnerstag 29 Mai 2008 17:06:41 schrieb Sascha Ottolski: Hi, asked it some weeks ago, but got no answer :-( when running configure, I see this error: ./configure: line 19292: syntax error near unexpected token `VARNISHAPI,' ./configure: line 19292: `PKG_CHECK_MODULES(VARNISHAPI

Re: make varnish still respond if backend dead

2008-04-24 Thread Sascha Ottolski
) { set obj.ttl = 7200s; } } so 404 still may happen, but are cached shorter than my default. Cheers, Sascha On Fri, Apr 4, 2008 at 12:51 AM, Sascha Ottolski [EMAIL PROTECTED] wrote: Hi, sorry if this is FAQ: what can I do to make varnish respond to request if it's backend

Re: mass purge causes high load?

2008-04-14 Thread Sascha Ottolski
Am Montag 14 April 2008 14:19:11 schrieb Dag-Erling Smørgrav: Sascha Ottolski [EMAIL PROTECTED] writes: Dag-Erling Smørgrav [EMAIL PROTECTED] writes: No, the semantics are completely different. With HTTP PURGE, you do a direct cache lookup, and set the object's TTL to 0 if it exists

mass purge causes high load?

2008-04-10 Thread Sascha Ottolski
Hi, I just needed to get rid of about 27,000 stale URLs, that were cached as 404 or 302 due to a configuration error on the backends. So I did a url.purge in a loop, sleeping 0.1 seconds after each URL: for i in `cat notfound.txt.sorted` ; do varnishadm -T:81 url.purge $i; sleep 0.1; done

recommendation for swap space?

2008-04-06 Thread Sascha Ottolski
Hi, now that my varnish processes start to reach the RAM size, I'm wondering what a dimension of swap would be wise? I currently have about 30 GB swap space for 32 GB RAM, but am wondering if it could even make sense to have no swap at all? My cache file is 517 GB in size. BTW, the trunk

Re: cache empties itself?

2008-04-04 Thread Sascha Ottolski
Am Freitag 04 April 2008 01:32:28 schrieb DHF: Sascha Ottolski wrote: however, my main problem is currently that the varnish childs keep restarting, and that this empties the cache, which effectively renders the whole setup useless for me :-( if the cache has filled up, it works great

Re: cache empties itself?

2008-04-04 Thread Sascha Ottolski
Am Freitag 04 April 2008 04:37:44 schrieb Ricardo Newbery:           sub vcl_fetch {               if (obj.ttl 120s) {                   set obj.ttl = 120s;               }           } Or you can invent your own header... let's call it  X-Varnish-1day           sub vcl_fetch {          

make varnish still respond if backend dead

2008-04-04 Thread Sascha Ottolski
Hi, sorry if this is FAQ: what can I do to make varnish respond to request if it's backend is dead. should return cache hits, of course, and a proxy error or something for a miss. and how can I prevent varnish to cache 404 for objects it couldn't fetch due to a dead backend? at least I think

Re: cache empties itself?

2008-04-04 Thread Sascha Ottolski
Am Freitag 04 April 2008 10:11:52 schrieb Stig Sandbeck Mathisen: On Fri, 4 Apr 2008 09:01:57 +0200, Sascha Ottolski [EMAIL PROTECTED] said: I definetely did nothing like this, I've observed restarts out of the blue. I'm no giving the trunk a try, hopefully there's an improvement

unable to compile nagios module from trunk

2008-04-04 Thread Sascha Ottolski
after checking out and running autogen.sh, configure stops with this error: ./configure: line 19308: syntax error near unexpected token `VARNISHAPI,' ./configure: line 19308: `PKG_CHECK_MODULES(VARNISHAPI, varnishapi)' Cheers, Sascha ___ varnish-misc

Re: cache empties itself?

2008-04-04 Thread Sascha Ottolski
Am Freitag 04 April 2008 18:11:23 schrieb Michael S. Fischer: On Fri, Apr 4, 2008 at 3:20 AM, Sascha Ottolski [EMAIL PROTECTED] wrote: you are right, _if_ the working set is small. in my case, we're talking 20+ mio. small images (5-50 KB each), 400+ GB in total size, and it's growing

Re: cache empties itself?

2008-04-03 Thread Sascha Ottolski
Am Donnerstag 03 April 2008 18:07:53 schrieb DHF: Sascha Ottolski wrote: how can this be? My varnish runs for about 36 hours now. yesterday evening, the resident memory size was like 10 GB, which is still way below the available 32. later that evening, I stopped letting request

Re: cache empties itself?

2008-04-03 Thread Sascha Ottolski
Am Donnerstag 03 April 2008 18:07:53 schrieb DHF: how can this be? My varnish runs for about 36 hours now. yesterday evening, the resident memory size was like 10 GB, which is still way below the available 32. later that evening, I stopped letting request to the proxy over night. now I

Re: cache empties itself?

2008-04-03 Thread Sascha Ottolski
Am Donnerstag 03 April 2008 19:30:25 schrieb Michael S. Fischer: On Thu, Apr 3, 2008 at 10:26 AM, Sascha Ottolski [EMAIL PROTECTED] wrote: All this with 1.1.2. It's vital to my setup to cache as many objects as possible, for a long time, and that they really stay in the cache

Re: the most basic config

2008-04-02 Thread Sascha Ottolski
Am Dienstag 01 April 2008 21:15:11 schrieb Sascha Ottolski: thanks very much, this was very helpful. now, could anyone give me a hint how to interpret the output of varnishhist? I'm seeing client_req              15054       123.39 Client requests received cache_hit                1632

the most basic config

2008-04-01 Thread Sascha Ottolski
Hi, I'm a bit puzzled by the examples and the explanation of the default vcl config presented in the man page. Now I'm wondering, if I want to make my first steps for creating a reverse proxy for static images only, that basically should cache everything indefinetely (as long as cache space

Re: the most basic config

2008-04-01 Thread Sascha Ottolski
Am Dienstag 01 April 2008 17:42:17 schrieb DHF: Sascha Ottolski wrote: Hi, I'm a bit puzzled by the examples and the explanation of the default vcl config presented in the man page. Now I'm wondering, if I want to make my first steps for creating a reverse proxy for static images only

Re: Miscellaneous questions

2008-03-31 Thread Sascha Ottolski
Am Dienstag 18 März 2008 00:07:59 schrieb Michael S. Fischer: On Mon, Mar 17, 2008 at 3:32 PM, DHF [EMAIL PROTECTED] wrote: This is called CARP/Cache Array Routing Protocol in squid land. Here's a link to some info on it: http://docs.huihoo.com/gnu_linux/squid/html/x2398.html It

production ready devel snapshot?

2008-03-31 Thread Sascha Ottolski
Hi, probably a stupid question, but if I'd like to use more recent features like the load-balancer, and since the latest official release is a bit dated, is there anything like a snapshot release that is worth giving it a try, especially if my configuration will hopefully stay simple for a

Re: how to...accelarate randon access to millions of images?

2008-03-17 Thread Sascha Ottolski
Am Sonntag 16 März 2008 15:54:42 schrieben Sie: Sascha Ottolski [EMAIL PROTECTED] writes: Now my question is: what kind of hardware would I need? Lots of RAM seems to be obvious, what ever a lot may be...What about the disk subsystem? Should I look into something like RAID-0 with many disk

Re: how to...accelarate randon access to millions of images?

2008-03-17 Thread Sascha Ottolski
Michael, thanks a lot for taking the time to give me such a detailed answer. please see my replies below. Am Sonntag 16 März 2008 18:00:42 schrieb Michael S. Fischer: On Fri, Mar 14, 2008 at 1:37 PM, Sascha Ottolski [EMAIL PROTECTED] wrote: The challenge is to server 20+ million image

how to...accelarate randon access to millions of images?

2008-03-14 Thread Sascha Ottolski
Hi, I'm relatively new to varnish (I'm having an eye on it since it appeared in public, but so far never really used it). Now the time may have come to give it whirl. And am wondering if someone could give me a little advise to get me going. The challenge is to server 20+ million image files,