I had a large cluster of failures around 8PM to 8:30 PM yesterday
(PST). Then there was the issues at 5AM as you mentioned.
I've since had clusters of issues at 8AM, 11 AM, 2PM
I'm running on Python. My App ID is slconductor
Many failures are 500 Server error "The server encountered an error
and could not complete your request."
when they do get through, it's usually a Deadline Exceeded error, with
the failure always in the same place:
<class 'google.appengine.runtime.DeadlineExceededError'>:
Traceback (most recent call last):
File "/base/data/home/apps/slconductor/1-6.344784435568344209/
cards.py", line 896, in main
run_wsgi_app(application)
File "/base/python_runtime/python_lib/versions/1/google/appengine/
ext/webapp/util.py", line 97, in run_wsgi_app
run_bare_wsgi_app(add_wsgi_middleware(application))
File "/base/python_runtime/python_lib/versions/1/google/appengine/
ext/webapp/util.py", line 115, in run_bare_wsgi_app
result = application(env, _start_response)
File "/base/python_runtime/python_lib/versions/1/google/appengine/
ext/webapp/__init__.py", line 511, in __call__
handler.get(*groups)
File "/base/data/home/apps/slconductor/1-6.344784435568344209/
cards.py", line 566, in get
db.put([item_record, user_record])
File "/base/python_runtime/python_lib/versions/1/google/appengine/
ext/db/__init__.py", line 1338, in put
keys = datastore.Put(entities, rpc=rpc)
File "/base/python_runtime/python_lib/versions/1/google/appengine/
api/datastore.py", line 291, in Put
'datastore_v3', 'Put', req, datastore_pb.PutResponse(), rpc)
File "/base/python_runtime/python_lib/versions/1/google/appengine/
api/datastore.py", line 194, in _MakeSyncCall
rpc.wait()
File "/base/python_runtime/python_lib/versions/1/google/appengine/
api/apiproxy_stub_map.py", line 460, in wait
self.__rpc.Wait()
File "/base/python_runtime/python_lib/versions/1/google/appengine/
api/apiproxy_rpc.py", line 112, in Wait
rpc_completed = self._WaitImpl()
File "/base/python_runtime/python_lib/versions/1/google/appengine/
runtime/apiproxy.py", line 108, in _WaitImpl
rpc_completed = _apphosting_runtime___python__apiproxy.Wait(self)
I may see 1 error a week. it's been error after error all day.
On Sep 14, 1:45 pm, "Ikai Lan (Google)" <[email protected]>
wrote:
> Can you guys list how often you guys see these? Here's some information
> that'd be helpful for us:
>
> - What % of your requests return "Request was aborted"? Is it happening at
> specific times? Java or Python?
> - App ID
>
> There was a latency spike around 4am
> (http://groups.google.com/group/google-appengine-downtime-notify/brows...)
> and a minor spike about 6 hours after that.
>
>
>
> On Tue, Sep 14, 2010 at 1:36 PM, Arny <[email protected]> wrote:
> > We're having the same issue.
>
> > Worked fine until the maintenance, as far I remember.
> > Now our logs are filled with:
>
> > #
> > # Request was aborted after waiting too long to attempt to service
> > your request. This may happen sporadically when the App Engine serving
> > cluster is under unexpectedly high or uneven load. If you see this
> > message frequently, please contact the App Engine team.
> > #
>
> > Even we do only get about 8-10 requests/sec and all our responses are
> > memcached.
>
> > Any word from the AppEngine Team?
>
> > On Sep 14, 11:14 am, mscwd01 <[email protected]> wrote:
> > > Hey,
>
> > > This may just be a coincidence but my average CPU time per request has
> > > risen noticably since yesterdays maintenance. Whereas my average was
> > > 250-300ms, it now takes on average 500-600ms. This is the exact same
> > > resource without any changes made, so I cannot seem to work out why
> > > this would be. Has anyone else noticed this?
>
> > > Thanks
>
> > --
> > You received this message because you are subscribed to the Google Groups
> > "Google App Engine" group.
> > To post to this group, send email to [email protected].
> > To unsubscribe from this group, send email to
> > [email protected]<google-appengine%2Bunsubscrib
> > [email protected]>
> > .
> > For more options, visit this group at
> >http://groups.google.com/group/google-appengine?hl=en.
--
You received this message because you are subscribed to the Google Groups
"Google App Engine" group.
To post to this group, send email to [email protected].
To unsubscribe from this group, send email to
[email protected].
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en.
