I don't know what your URLS look like, but I would take the old URLS and have your app serve a 410 error to those. And do that early in your app logic.
Also if you are trying to run for free, Python 2.7 thread safe will help a lot. -----Original Message----- From: [email protected] [mailto:[email protected]] On Behalf Of Anders Sent: Thursday, January 26, 2012 12:53 PM To: Google App Engine Subject: [google-appengine] over quota - google bots I recently made a significant change in my app (python 2.5) when I had to "collapse" many pages into one - hiding functionality for users that had become unstable/unauthorized. I am definitely a newbie to how this would impact search engine bots, but basically a huge number of pages all changed and got redirected to the same "you can't see that anymore" type page. Since this occurred, my stable and growing app of ~ 3yrs has continually crashed with over quota errors - specifically read requests. My naive approach is to blacklist the ips of the bots hitting the page so much, but this only temporarily fixes the problem until a new bot does the same. I saw the following encouraging post of a user that found a solution: http://groups.google.com/group/google-appengine/browse_thread/thread/3c91056 b8be5c9a7/44a9baa0ef38a047?lnk=gst&q=over+quota+read+operations+by+google+bo t#44a9baa0ef38a047 So it looks like I need to use memcache, something in the past I hadn't needed/investigated how to use. Any other quick fix solutions? I need to keep the site up (and affordable!) until I can put in the development time to relieve this issue. -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to [email protected]. To unsubscribe from this group, send email to [email protected]. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to [email protected]. To unsubscribe from this group, send email to [email protected]. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
