Requests to our EU resident backends (Premier Account) stopped responding after 23:04 UTC and the last logged request contained the following error:
com.google.apphosting.api.ApiProxy$ApiDeadlineExceededException: The API call memcache.set() took too long to respond and was cancelled. Thereafter, both backends were dead or let's say Google returned the following error (see attached images): Error: Server The service you requested is not available yet. Please try again in 30 seconds. After restarting the backends, both responded normally again. If Google detects such errors, they really need to work on their monitoring processes in order to automatically restart / move backends to another data center etc. It cannot be that they are shown as 'running' and Google happily outputs an error message to the remote applications that were trying to communicate with our backends. Looking forward to improvement! Marcel -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To post to this group, send email to [email protected]. Visit this group at http://groups.google.com/group/google-appengine?hl=en. For more options, visit https://groups.google.com/groups/opt_out.
<<attachment: processors_error.png>>
<<attachment: processors_requests.png>>
<<attachment: processors_running.png>>
