This has been happening on and off but today it's really off the charts. Currently have 28k tasks and none of them are executed. I filed #13118 for that.
On Friday, May 13, 2016 at 8:44:57 PM UTC+2, Nick (Cloud Platform Support) wrote: > > Thanks for the update. Barring a very low setting for "max concurrent > tasks", I don't see why this could occur, so it appears this could be a > production issue. In that case, I'd recommend opening a Public Issue > Tracker <http://code.google.com/p/googleappengine/issues/list> thread > with label "Restrict-View-EditIssue" (to protect your information) and the > following information: > > * your app id > * the name of the queue > * the queue settings > * some queue statistics > > We may be able to determine the root cause of this at that point. > > Sincerely, > > Nick > Cloud Platform Community Support > > On Friday, May 13, 2016 at 2:02:04 PM UTC-4, Hugo Visser wrote: >> >> Just got an alert again. The task rate is 25 tasks/sec with a bucket size >> of 10. Average latency of the handlers is varying depending on the task, >> but anywhere between 1 and 8 seconds. >> >> The thing that I'm seeing is that the task queue shows 120 tasks in the >> queue, 0 running, oldest task ETA 6 minutes ago. That doesn't seem right to >> me, and it looks like these tasks are just not being executed. I see >> nothing in the logs of my task handlers that indicate that a request is >> being executed. >> >> Obviously this task execution thing is pretty essential to my app. >> >> Hugo >> >> On Wednesday, May 11, 2016 at 11:34:34 PM UTC+2, Nick (Cloud Platform >> Support) wrote: >>> >>> Thanks for coming back to update. Feel free to post again with the >>> information mentioned if you notice anything in the future. >>> >>> Best wishes, >>> >>> Nick >>> Cloud Platform Community Support >>> >>> On Wednesday, May 11, 2016 at 4:33:36 PM UTC-4, Hugo Visser wrote: >>>> >>>> It looks like the queues are back to normal. I've setup alerts in stack >>>> driver that triggered for a while but are resolved now. Will report back >>>> if >>>> that changes. >>>> >>>> On Wed, May 11, 2016, 21:08 'Nick (Cloud Platform Support)' via Google >>>> App Engine <[email protected]> wrote: >>>> >>>>> Hey Hugo, >>>>> >>>>> Without knowing more about A) the configuration of the queue, B) the >>>>> rate of task creation, C) the latency statistics on the task handler, >>>>> it's >>>>> difficult to say much on why this might be happening. If you could gather >>>>> all those types of information, myself or someone else may be able to >>>>> leave >>>>> a more insightful comment. >>>>> >>>>> Cheers, >>>>> >>>>> Nick >>>>> Cloud Platform Community Support >>>>> >>>>> >>>>> On Tuesday, May 10, 2016 at 4:54:00 AM UTC-4, Hugo Visser wrote: >>>>>> >>>>>> I'm seeing tasks in my queue that are there for 6 minutes without any >>>>>> tasks running at all. There doesn't seem to be much I can do about this >>>>>> which is really frustrating. >>>>>> >>>>>> On Tuesday, May 10, 2016 at 8:54:33 AM UTC+2, Hugo Visser wrote: >>>>>>> >>>>>>> Since last night or so I'm seeing this issue where tasks are being >>>>>>> queued up for some time and not being executed on an app that has been >>>>>>> running like this for quite a while. This results in a huge pile of >>>>>>> tasks >>>>>>> that get backlogged for my app. >>>>>>> >>>>>>> Cloud status dashboard says everything is OK. Anyone else seeing >>>>>>> this? >>>>>>> >>>>>>> Hugo >>>>>>> >>>>>> -- >>>>> You received this message because you are subscribed to a topic in the >>>>> Google Groups "Google App Engine" group. >>>>> To unsubscribe from this topic, visit >>>>> https://groups.google.com/d/topic/google-appengine/MYxDL8sihN4/unsubscribe >>>>> . >>>>> To unsubscribe from this group and all its topics, send an email to >>>>> [email protected]. >>>>> To post to this group, send email to [email protected]. >>>>> Visit this group at https://groups.google.com/group/google-appengine. >>>>> To view this discussion on the web visit >>>>> https://groups.google.com/d/msgid/google-appengine/370b31f3-e1fa-4a2f-9287-652aeac0500c%40googlegroups.com >>>>> >>>>> <https://groups.google.com/d/msgid/google-appengine/370b31f3-e1fa-4a2f-9287-652aeac0500c%40googlegroups.com?utm_medium=email&utm_source=footer> >>>>> . >>>>> For more options, visit https://groups.google.com/d/optout. >>>>> >>>> -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To post to this group, send email to [email protected]. Visit this group at https://groups.google.com/group/google-appengine. To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/c982de60-4fb9-4d33-ab47-fd3cf160be78%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
