Re: logging problems - Pipe Shut

2007-07-05 Thread Gaute Amundsen
Ah, OK, you won't be able to process log files larger than about 2 GB on a 32-bit machine. I should probably figure out a way to get around that. Ok, now I have set up /var/log/varnish/varnish.log to rotate every hour, and a postrotate action on that to pipe through varnishncsa and append

Re: logging problems - Pipe Shut

2007-07-05 Thread Dag-Erling Smørgrav
Gaute Amundsen [EMAIL PROTECTED] writes: I made a small script to run varnish(log|ncsa) on every file and get the returnstatus. log works fine, and a tail of that diplays sensible output and timestamps, but ncsa segfaults on about half of them. No pattern discernible.. Can you send me one of

Re: logging problems - Pipe Shut

2007-07-05 Thread Gaute Amundsen
That did the trick for the processing :-D Only the logging itself left then. With som luck logger restarts on logrotate every hour will keep that stable til 1.1 is out :-) Gaute On Thursday 05 July 2007 20:20, Gaute Amundsen wrote: On Thursday 05 July 2007 17:18, Dag-Erling Smørgrav wrote:

Re: logging problems - Pipe Shut

2007-07-03 Thread Dag-Erling Smørgrav
Gaute Amundsen [EMAIL PROTECTED] writes: We have had logging running for about a week now with no apparent problems, but yesterday I routed all our traffic into varnish, and now bad things happen. /var/log/varnish/varnish.log just stops growing after a while and a tail -n 1 gives me pages

Re: logging problems - Pipe Shut

2007-07-03 Thread Gaute Amundsen
Hm.. I was finding quite a bit of Pipe Shut just running varnishlog -o. I's out of my buffer, so I cant paste it in right now, but could it bee that I was opening to many pipes? I the default action in vcl_recv was pipe, and only a few hosts would get a lookup... Trying with pass now, and it

Re: logging problems - Pipe Shut

2007-07-03 Thread Dag-Erling Smørgrav
Gaute Amundsen [EMAIL PROTECTED] writes: I was finding quite a bit of Pipe Shut just running varnishlog -o. I's out of my buffer, so I cant paste it in right now, but could it bee that I was opening to many pipes? pipe shut happens when either the backend or the client closes the connection,

Re: logging problems - Pipe Shut

2007-07-03 Thread Gaute Amundsen
On Tuesday 03 July 2007 16:05, Dag-Erling Smørgrav wrote: Gaute Amundsen [EMAIL PROTECTED] writes: Rotation is weekly, and the previous logs have sane dates. Weekly rotation is probably far too seldom, Varnish can easily generate several gigabytes of log data *per hour* under high load. The

Re: logging problems - Pipe Shut

2007-07-03 Thread Dag-Erling Smørgrav
Gaute Amundsen [EMAIL PROTECTED] writes: On Tuesday 03 July 2007 16:05, Dag-Erling Smørgrav wrote: Gaute Amundsen [EMAIL PROTECTED] writes: Rotation is weekly, and the previous logs have sane dates. Weekly rotation is probably far too seldom, Varnish can easily generate several gigabytes

Re: logging problems - Pipe Shut

2007-07-03 Thread Gaute Amundsen
On Tuesday 03 July 2007 16:30, Dag-Erling Smørgrav wrote: snip varnishncsa shouldn't care, as it processes the log file linearly, but I generally prefer to rotate by size. Hm.. ok. But that would have me running awstats at odd times.. Wil just have to try it out I guess Is this a 32-bit