Query on deletion of Request pool

2008-03-26 Thread Arnab Ganguly
Hi All, I am getting a serious memory issue with my Apache webserver. Initially I was allocating buffer from by using apr_palloc from the request pool assuming the allocated memory is going to be released but not sure what is the problem the memory grows infinitely. I then tried with own malloc

Re: Query on deletion of Request pool

2008-03-26 Thread Eric Covener
On Wed, Mar 26, 2008 at 11:39 AM, Arnab Ganguly [EMAIL PROTECTED] wrote: Hi All, I am getting a serious memory issue with my Apache webserver. Initially I was allocating buffer from by using apr_palloc from the request pool assuming the allocated memory is going to be released but not sure

Re: flood random subst patch

2008-03-26 Thread Plüm , Rüdiger , VF-Group
-Ursprüngliche Nachricht- Von: Sander Temme Gesendet: Mittwoch, 26. März 2008 06:48 An: dev@httpd.apache.org Betreff: Re: flood random subst patch On Mar 25, 2008, at 9:32 PM, James M. Leddy wrote: A Flood 'project', a httpd-test 'project' with a flood 'component',

Dynamic configuration for the hackathon?

2008-03-26 Thread Nick Kew
There seems to be a demand for dynamic per-request configuration, as evidenced by the number of users hacking it with mod_rewrite, and the other very limited tools available. Modern mod_rewrite usage commonly looks like programming, but it's not designed as a programming language. Result:

Re: Dynamic configuration for the hackathon?

2008-03-26 Thread Akins, Brian
On 3/26/08 9:06 AM, Nick Kew [EMAIL PROTECTED] wrote: There seems to be a demand for dynamic per-request configuration, as evidenced by the number of users hacking it with mod_rewrite, and the other very limited tools available. Modern mod_rewrite usage commonly looks like programming, but

Re: Dynamic configuration for the hackathon?

2008-03-26 Thread Issac Goldstand
Akins, Brian wrote: On 3/26/08 9:06 AM, Nick Kew [EMAIL PROTECTED] wrote: There seems to be a demand for dynamic per-request configuration, as evidenced by the number of users hacking it with mod_rewrite, and the other very limited tools available. Modern mod_rewrite usage commonly looks

Re: Dynamic configuration for the hackathon?

2008-03-26 Thread Nick Kew
On Wed, 26 Mar 2008 15:39:53 +0200 Issac Goldstand [EMAIL PROTECTED] wrote: Akins, Brian wrote: On 3/26/08 9:06 AM, Nick Kew [EMAIL PROTECTED] wrote: There seems to be a demand for dynamic per-request configuration, as evidenced by the number of users hacking it with mod_rewrite,

Re: flood random subst patch

2008-03-26 Thread William A. Rowe, Jr.
Sander Temme wrote: On Mar 25, 2008, at 9:32 PM, James M. Leddy wrote: A Flood 'project', a httpd-test 'project' with a flood 'component', or an httpd 'project' with new subprojects. Thank you for making this clear. My vote is for choice #2. I'd also tend towards a httpd-test Product

Re: Dynamic configuration for the hackathon?

2008-03-26 Thread Akins, Brian
On 3/26/08 9:53 AM, Nick Kew [EMAIL PROTECTED] wrote: I'm not talking about inventing a new language. Those who want one have some options already, as noted below ... Right. I was just throwing it out there, so to speak. I'm not opposed to what you are saying, just wondering if we

Re: Dynamic configuration for the hackathon?

2008-03-26 Thread Nick Kew
On Wed, 26 Mar 2008 10:15:05 -0400 Akins, Brian [EMAIL PROTECTED] wrote: As to your suggestion: So basically, the per_dir merge would use this mechanism instead of what it does now (file walk, location walk) (or in addition to??) Something like: If Directory == /www/stuff and Remote_IP

Re: mod_disk_cache and atimes

2008-03-26 Thread Dirk-Willem van Gulik
On Mar 25, 2008, at 8:04 PM, Akins, Brian wrote: Use really small files so you won't fill up pipe. Using 1 1x1 gif, I run out of CPU before I run out of bandwidth. Agreed. This is what I was working on. My cache size is smaller and is in /dev/shm. In that case - you are not going to

Re: mod_disk_cache and atimes

2008-03-26 Thread Konstantin Chuguev
Hi Dirk-Willem, Can you please clarify your mentioning the bucket-brigade footprint? Are they so slow they make memory-based cache no more efficient then disk-based one? Or the opposite: sendfile() works so well that serving content from memory is not any faster? I'm developing an Apache

Proposal: a cron interface for httpd

2008-03-26 Thread Graham Leggett
Hi all, On a number of occasions recently I have run into the need to run some kind of garbage collection within httpd, either in a dedicated process, or a dedicated thread. Attempts to solve this to date have involved setting up of external tools to try and solve garbage collection

Re: Proposal: a cron interface for httpd

2008-03-26 Thread Nick Kew
On Wed, 26 Mar 2008 17:55:43 +0200 Graham Leggett [EMAIL PROTECTED] wrote: Before I code anything up, is this acceptable or are there glaring holes that I have not foreseen? ap_hook_monitor? -- Nick Kew Application Development with Apache - the Apache Modules Book

Re: Proposal: a cron interface for httpd

2008-03-26 Thread Rainer Jung
Graham Leggett wrote: Hi all, On a number of occasions recently I have run into the need to run some kind of garbage collection within httpd, either in a dedicated process, or a dedicated thread. Attempts to solve this to date have involved setting up of external tools to try and solve

Re: Proposal: a cron interface for httpd

2008-03-26 Thread Graham Leggett
Nick Kew wrote: ap_hook_monitor? A quick look found the hook, but no comments or other docs on how it works. The only code in the tree using the hook is mod_example_hooks, but it doesn't reveal any information either. Is this hook documented anywhere? I don't want to add something we

Excessive chunking [was: mod_disk_cache and atimes]

2008-03-26 Thread Konstantin Chuguev
Thanks for the clarification. A small correction: I meant writev() calls instead of sendfile() when working with small-size buckets. The filter I'm developing provisionally splits the supplied buckets into relatively small buckets during content parsing. It then removes some of them and

Re: Proposal: a cron interface for httpd

2008-03-26 Thread Graham Leggett
Plüm wrote: What data do you supply to the hooks? What if the execution of the hook takes longer then the defined frequency of this hook? That is something we decide, and code accordingly, depending on what we think we need. We could come up with something capable of spawning a dedicated

Re: Excessive chunking [was: mod_disk_cache and atimes]

2008-03-26 Thread Dirk-Willem van Gulik
On Mar 26, 2008, at 5:23 PM, Konstantin Chuguev wrote: A small correction: I meant writev() calls instead of sendfile() when working with small-size buckets. The filter I'm developing provisionally splits the supplied buckets into relatively small buckets during content parsing. It then

Re: Dynamic configuration for the hackathon?

2008-03-26 Thread Akins, Brian
On 3/26/08 10:31 AM, Nick Kew [EMAIL PROTECTED] wrote: Straightforward: conditions on headers, method (obsoletes Limit), request line, env, CGI vars. With the option to disable conditional stuff for speed. In mod_include, we parse into a tree on every request. For the configuration, we

Re: Proposal: a cron interface for httpd

2008-03-26 Thread Dirk-Willem van Gulik
On Mar 26, 2008, at 5:35 PM, Graham Leggett wrote: We could come up with something capable of spawning a dedicated process and/or thread every time there is a successful tick to run that tick, so that tick+1 isn't delayed if there is an overrun. Or reduce the interface to a simple

Re: Dynamic configuration for the hackathon?

2008-03-26 Thread Akins, Brian
On 3/26/08 12:42 PM, Akins, Brian [EMAIL PROTECTED] wrote: Thoughts? Of course, it will not work exactly as I have said because we have to take stuff like variable substitution into account, etc. Was just thinking out loud... -- Brian Akins Chief Operations Engineer Turner Digital Media

Re: Dynamic configuration for the hackathon?

2008-03-26 Thread Nick Kew
On Wed, 26 Mar 2008 12:42:51 -0400 Akins, Brian [EMAIL PROTECTED] wrote: On 3/26/08 10:31 AM, Nick Kew [EMAIL PROTECTED] wrote: Straightforward: conditions on headers, method (obsoletes Limit), request line, env, CGI vars. With the option to disable conditional stuff for speed. In

Re: Dynamic configuration for the hackathon?

2008-03-26 Thread Akins, Brian
On 3/26/08 1:14 PM, Nick Kew [EMAIL PROTECTED] wrote: we have to parse a string before we have Remote_IP. Once we have that, sure, our evaluation function can dispatch to the Remote_IP handler. Of course. I was getting ahead of my self... You seem to be looking a little further than my

Re: Proposal: a cron interface for httpd

2008-03-26 Thread Jim Jagielski
On Mar 26, 2008, at 11:55 AM, Graham Leggett wrote: Hi all, On a number of occasions recently I have run into the need to run some kind of garbage collection within httpd, either in a dedicated process, or a dedicated thread. Attempts to solve this to date have involved setting up of

Re: Proposal: a cron interface for httpd

2008-03-26 Thread Graham Leggett
Dirk-Willem van Gulik wrote: Or reduce the interface to a simple 'register callback 'at or before', or 'at or after' this time - and leave it up to the called entity to re-register itself. The Eclipse Job interface works like this, you basically say run this X ms from now, and if you want

Re: Proposal: a cron interface for httpd

2008-03-26 Thread Dirk-Willem van Gulik
On Mar 26, 2008, at 6:45 PM, Graham Leggett wrote: Dirk-Willem van Gulik wrote: Or reduce the interface to a simple 'register callback 'at or before', or 'at or after' this time - and leave it up to the called entity to re-register itself. The Eclipse Job interface works like this, you

Re: Proposal: a cron interface for httpd

2008-03-26 Thread Chris Darroch
Graham Leggett wrote: On a number of occasions recently I have run into the need to run some kind of garbage collection within httpd, either in a dedicated process, or a dedicated thread. I've also written a few modules where each child process runs a private thread in the background. I'd

Re: Proposal: a cron interface for httpd

2008-03-26 Thread Akins, Brian
The way I do this is simple and primitive. If I have an action I need to be ran, I do something like: Location /my-cron-job-thing SetHandler MyCronJobThing Allow from 127.0.0.1 Deny from All /Location And then in cron * * * * * curl http://localhost/my-cron-job-thing

Re: Proposal: a cron interface for httpd

2008-03-26 Thread Jim Jagielski
On Mar 26, 2008, at 2:52 PM, Akins, Brian wrote: The way I do this is simple and primitive. If I have an action I need to be ran, I do something like: Location /my-cron-job-thing SetHandler MyCronJobThing Allow from 127.0.0.1 Deny from All /Location And then in cron * * * * *