Jason, it looks like you're seeing transaction contention, and the datastore latency spikes are exacerbating the effect of transactional backoffs, causing task queues to back up.
We're aware of the datastore spikes and are monitoring the situation. -- Ikai Lan Developer Programs Engineer, Google App Engine Blogger: http://googleappengine.blogspot.com Reddit: http://www.reddit.com/r/appengine Twitter: http://twitter.com/app_engine On Wed, Oct 13, 2010 at 2:39 PM, Waleed Abdulla <[email protected]> wrote: > I'm getting a ton of datastore timeouts as well. app id = networkedhub > > > The datastore operation timed out, or the data was temporarily unavailable. > > > Waleed > > > > On Wed, Oct 13, 2010 at 2:16 PM, Jason C <[email protected]>wrote: > >> I should clarify. Our queues are _really_ falling behind because our >> handlers are timing out extensively causing lots of retries, etc. And >> quota usage, and presumably $$ usage. >> >> j >> >> On Oct 13, 2:59 pm, Jason C <[email protected]> wrote: >> > Our queues are _really_ falling behind. (appid steprep) >> > >> > Can anyone from Google comment on this, please? >> > >> > Thanks, >> > j >> > >> > On Oct 13, 1:13 pm, Jason C <[email protected]> wrote: >> > >> > >> > >> > > This is still occurring. For appid steprep at 2010-10-13 12.10p (log >> > > time), we just saw a burst of around 380 10-s and 30-s timeouts >> > > (mostly the 10-s variety). >> > >> > > j >> > >> > > On Oct 12, 11:47 pm, pdknsk <[email protected]> wrote: >> > >> > > > I'm getting a fair amount of these. >> > >> > > > A serious problem was encountered with the process that handled this >> > > > request, causing it to exit. This is likely to cause a new process >> to >> > > > be used for the next request to your application. If you see this >> > > > message frequently, you should contact the App Engine team. (Error >> > > > code 203) >> >> -- >> You received this message because you are subscribed to the Google Groups >> "Google App Engine" group. >> To post to this group, send email to [email protected]. >> To unsubscribe from this group, send email to >> [email protected]<google-appengine%[email protected]> >> . >> For more options, visit this group at >> http://groups.google.com/group/google-appengine?hl=en. >> >> > -- > You received this message because you are subscribed to the Google Groups > "Google App Engine" group. > To post to this group, send email to [email protected]. > To unsubscribe from this group, send email to > [email protected]<google-appengine%[email protected]> > . > For more options, visit this group at > http://groups.google.com/group/google-appengine?hl=en. > -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to [email protected]. To unsubscribe from this group, send email to [email protected]. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
