Hi Dan, From what I've seen the queues run largely independent from each other. Of course, there are events that can impact your app as a whole. If you've got one queue that is pounding very hard on the datastore and it starts causing errors, that would naturally impact your other queues. Also, I know you *can* run tasks for 10 minutes, but I get significantly better throughput with tasks that run very fast (I generally prefer many fast tasks to a few slow ones). From what I've seen, if you've got a relatively large number of slow tasks (or worse user-requests!), that can negatively impact the entire app (since you'll get fewer instances).
I can give you some of my observations, maybe they will help a little. I occasionally see one queue slow down for no obvious reason, because of this when I'm trying to do sustained high-volume stuff I spread it over a few queues. It seems to help keep the overall rates up. When a queue starts having a lot of tasks fail, that queue seems to slow down a bit, but other queues don't (unless the reason it is slowing is global, say because of datastore issues). Depending on my needs, I like to put 'slow' tasks in their own slow queue. I do this because if the latency of the tasks in a queue is high, that queue seems to slow down. Obviously for some use cases you might rather mix the slow tasks with a lot of fast tasks to prevent any slow downs. Robert On Thu, May 26, 2011 at 18:06, Dan Lines <[email protected]> wrote: > The question that I have concerns the speed of tasks running and completing > when there are a large number of tasks in different task queues. > Can the task load of one queue affect the performance of tasks in a > different task queue? > > > -- > You received this message because you are subscribed to the Google Groups > "Google App Engine" group. > To post to this group, send email to [email protected]. > To unsubscribe from this group, send email to > [email protected]. > For more options, visit this group at > http://groups.google.com/group/google-appengine?hl=en. > -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to [email protected]. To unsubscribe from this group, send email to [email protected]. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
