i agree waleed. ever since the 500 request/second limit was removed from GAE about a month ago, the Task queue has taken a pretty big hit. When they raised the queue limit to 40/sec it was flying but then the limit above was removed (a good thing!) and the amount of 500 errors in the queue went through the roof. I can't even come close the incredible performance I saw originally. Google told me to just make sure all tasks ran below 1 second but this doesn't even really help and IMO, defeats one of the main goals of the Task Queue itself (longer running processing, albeit below 30 secs)
brian On May 21, 2:00 pm, Waleed Abdulla <[email protected]> wrote: > It seems that the speed at which the task queue executes tasks is not > catching up to how fast I'm inserting tasks to it. See attached screen: the > "feed-pulls" task is set to a rate of 25/second and a bucket size of 20 (the > max allowed). I'd expect to see an execution rate of 1500 tasks per minute > or close to that, but instead it's running at a rate of about 400 tasks per > minute. As a result, the queue keeps getting longer (I have tasks that are 3 > days old still waiting to execute). > > What can I do about this? > > Regards, > Waleed > > -- > You received this message because you are subscribed to the Google Groups > "Google App Engine" group. > To post to this group, send email to [email protected]. > To unsubscribe from this group, send email to > [email protected]. > For more options, visit this group > athttp://groups.google.com/group/google-appengine?hl=en. > > Screen shot 2010-05-20 at 5.11.16 PM.png > 30KViewDownload -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to [email protected]. To unsubscribe from this group, send email to [email protected]. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
