For us the rate did not go down. There were millions of tasks created in 
the task queue (it should have been 40,000). The stored task byte count 
shot to 0.5GB

I then purged the queue and increased the stored task byte to 1.5GB a 
couple of hours ago. Everything seemed fine and now the stored task byte 
count has reached 1.5GB.


No code changes have been done by us, this started happen 10 hours ago. 
Please look into this.

App Id: justunfollow-h

On Friday, October 19, 2012 7:41:39 AM UTC+5:30, nverne wrote:
>
> Could you please give us some more details:
>
> Which rate did you see go down? The Maximum Rate or the Enforced Rate?
>
> Were your tasks running on backends or frontends?
>
> Do your admin logs indicate that you were the only developer uploading 
> changes?
>
> On Fri, Oct 19, 2012 at 12:59 PM, nischalshetty 
> <[email protected]<javascript:>
> > wrote:
>
>> We are facing problems with the task queue as well. The tasks shot up to 
>> millions and everything stopped working for us!
>>
>>
>> On Thursday, October 18, 2012 11:34:23 PM UTC+5:30, gks wrote:
>>>
>>> And the task queue of my app aos-prod-1 is lying about the # of tasks in 
>>> queue since it always says 100, which is impossible given my customers 
>>> usage pattern. 
>>>
>>> On Thursday, October 18, 2012 10:19:09 AM UTC-7, gks wrote:
>>>>
>>>> After I changed the processing rate to 100QPS to drain the queue, it 
>>>> was changed back to 5QPS just now. Can anyone from Google start looking 
>>>> into this issue and stop changing my task queue setting?
>>>>
>>>> On Thursday, October 18, 2012 9:42:17 AM UTC-7, gks wrote:
>>>>>
>>>>> I just found task queue processing rate of my apps was changed to 5qps 
>>>>> last night without any deployment from me! It caused a major service 
>>>>> interruption to my customers since a lot of tasks were delayed.
>>>>>
>>>>> There is no way this change came from my team since everyone was 
>>>>> sleeping when the change happened. And there is no corresponding 
>>>>> deployment 
>>>>> activity from admin log. Can Google provide an explanation on why it 
>>>>> happened, and what can be done to prevent it from happening again?
>>>>>
>>>>> My AppID are: aos-prod-1, aos-prod-2
>>>>>
>>>>  -- 
>> You received this message because you are subscribed to the Google Groups 
>> "Google App Engine" group.
>> To view this discussion on the web visit 
>> https://groups.google.com/d/msg/google-appengine/-/SIo8pCc0-WYJ.
>>
>> To post to this group, send email to 
>> [email protected]<javascript:>
>> .
>> To unsubscribe from this group, send email to 
>> [email protected] <javascript:>.
>> For more options, visit this group at 
>> http://groups.google.com/group/google-appengine?hl=en.
>>
>
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/e5waPxTjEBQJ.
To post to this group, send email to [email protected].
To unsubscribe from this group, send email to 
[email protected].
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Reply via email to