Re: asynchronous execution, was Re: implementing a set of queue-processing servers

2002-11-27 Thread Rob Nagler
Perrin Harkins writes: Bas A.Schulte wrote: I do when the delivery mechanism has failed for 6 hours and I have 12000 messages in the queue *and* make sure current messages get sent in time? I don't know, that's an application-specific choice. Of course JMS doesn't know either. This is

Re: asynchronous execution, was Re: implementing a set of queue-processing servers

2002-11-26 Thread Bas A . Schulte
Hi all, On Tuesday, November 19, 2002, at 11:09 PM, Perrin Harkins wrote: Stephen Adkins wrote: So what I think you are saying for option 2 is: * Apache children (web server processes with mod_perl) have two personalities: - user request processors - back-end work

Re: asynchronous execution, was Re: implementing a set of queue-processing servers

2002-11-26 Thread Rob Nagler
Bas A.Schulte writes: still is something I haven't figured out. Basically, I need some way to coordinate the children so each child can find out what the other children are doing. Use a table in your database. The DB needs to support row level locking (we use Oracle). Here's an example:

Re: asynchronous execution, was Re: implementing a set of queue-processing servers

2002-11-26 Thread Perrin Harkins
Bas A.Schulte wrote: none of them seemed to be stable/fast under heavy load even though I would have preferred that as it would allow me to do something to handle data-sharing between children via the parent which always seems to be in issue in Apache/mod_perl. What are you trying to share?

Re: asynchronous execution, was Re: implementing a set of queue-processing servers

2002-11-26 Thread Perrin Harkins
Nigel Hamilton wrote: I need to fork a lot of processes per request ... the memory cost of forking an apache child is too high though. So I've written my own mini webserver in Perl It doesn't seem like this would help much. The thing that makes mod_perl processes big is Perl. If you run

Re: asynchronous execution, was Re: implementing a set of queue-processing servers

2002-11-26 Thread Bas A . Schulte
Hi Perrin, On Tuesday, November 26, 2002, at 06:14 PM, Perrin Harkins wrote: Bas A.Schulte wrote: none of them seemed to be stable/fast under heavy load even though I would have preferred that as it would allow me to do something to handle data-sharing between children via the parent which

Re: asynchronous execution, was Re: implementing a set of queue-processing servers

2002-11-26 Thread Stephen Adkins
At 07:04 PM 11/26/2002 +0100, Bas A.Schulte wrote: On Tuesday, November 26, 2002, at 06:14 PM, Perrin Harkins wrote: Bas A.Schulte wrote: I have been looking at some of the IPC::Share* modules, the one I think I can use is (not sure here) IPC::ShareLite, but that darned thing won't install

Re: asynchronous execution, was Re: implementing a set of queue-processing servers

2002-11-26 Thread Nigel Hamilton
Quite odd. I read the performance thread that's on the P5EE page which showed that DBI (with MySQL underneath) was very fast, came in 2nd. Anyone care to elaborate why this is? After all, shared-memory is a thing in RAM, why isn't that faster? Hi Bas, You made some really

Re: asynchronous execution, was Re: implementing a set of queue-processing servers

2002-11-26 Thread Rob Nagler
Perrin Harkins writes: I think you are vastly over-estimating how much effort JMS/EJB/etc. would save you. EJB doesn't save you anything. It creates work and complexity, esp. Entity Beans. I've built large systems using EJB and Perl. The Perl project was built faster, with fewer people,

Re: asynchronous execution, was Re: implementing a set of queue-processing servers

2002-11-26 Thread Perrin Harkins
Bas A.Schulte wrote: Quite odd. I read the performance thread that's on the P5EE page which showed that DBI (with MySQL underneath) was very fast, came in 2nd. Anyone care to elaborate why this is? After all, shared-memory is a thing in RAM, why isn't that faster? I have an article that I'm

Re: asynchronous execution, was Re: implementing a set of queue-processing servers

2002-11-20 Thread Perrin Harkins
Aaron Johnson wrote: This model has eased my testing as well since I can run the script completely external of the web server I can run it through a debugger if needed. You realize that you can run mod_perl in the debugger too, right? I use the profiler and debugger with mod_perl

Re: asynchronous execution, was Re: implementing a set of queue-processing servers

2002-11-20 Thread Perrin Harkins
Aaron Johnson wrote: I know you _can_ , but I don't find it convenient. For me it's pretty much the same as debugging a command-line script. To debug a mod_perl handler I just do something like this: httpd -X -Ddebug Then I hit the URL with a browser or with GET and it pops me into the

Re: asynchronous execution, was Re: implementing a set of queue-processing servers

2002-11-20 Thread Rob Nagler
Perrin Harkins writes: I try to code it so that the business logic is not dependent on a certain runtime environment, and then write a small mod_perl handler to call it. I've been doing a lot of test-first coding. It makes it so that you start Apache, and the software just runs. With

Re: asynchronous execution, was Re: implementing a set of queue-processing servers

2002-11-19 Thread Perrin Harkins
Stephen Adkins wrote: So what I think you are saying for option 2 is: * Apache children (web server processes with mod_perl) have two personalities: - user request processors - back-end work processors * When a user submits work to the queue, the child is acting in a

Re: asynchronous execution, was Re: implementing a set of queue-processing servers

2002-11-19 Thread Valerio_Valdez Paolini
Hi Stephen, On Tue, 19 Nov 2002, Stephen Adkins wrote: My question with this approach is not whether it works for synchronous execution (the user is willing to wait for the results to come back) but whether it makes sense for asynchronous execution (the user will come back and get the

Re: asynchronous execution, was Re: implementing a set of queue-processing servers

2002-11-19 Thread Aaron Johnson
On Tue, 2002-11-19 at 16:28, Stephen Adkins wrote: At 08:18 PM 11/18/2002 -0700, Rob Nagler wrote: We digress. The problem is to build a UI to Sabre. I still haven't seen any numbers which demonstrate the simple solution doesn't work. Connecting to Sabre is no different than connecting