I even blocked a whole bunch of Google IP's and it just keeps hopping. This is insane.
From: [email protected] [mailto:[email protected]] On Behalf Of Brandon Wirtz Sent: Monday, May 16, 2011 4:16 PM To: [email protected] Subject: [google-appengine] Google Bot Trying to DoS me? Anyone at Google Help Me? Maybe I'm a bad person returning a 200 on this 404 page, but Google bot is just banging away at But this URL http://www.lockergnome.com/ <http://www.lockergnome.com/%3c/dan%20gray/davidbanther/theoracle/marc%20eri ckson/matt%20hartley/internetnut/schooltech/dannyminick/dylancombs/jfk/andro id/craighton/danwood/blade/theoracle/jake%20ludington> </dan%20gray/davidbanther/theoracle/marc%20erickson/matt%20hartley/interne tnut/schooltech/dannyminick/dylancombs/jfk/android/craighton/danwood/blade/t heoracle/jake%20ludington Is getting hit by Google Bot 3-30 times a second all day. That joke I made that GAE was getting a kick back from Search team is starting to look less funny. Here is the Log entry. Anyone know how I get someone in search to make this stop? /</dan%20gray/davidbanther/theoracle/marc%20erickson/matt%20hartley/intern etnut/schooltech/dannyminick/dylancombs/jfk/android/craighton/danwood/blade/ theoracle/jake%20ludington 200 13909ms 27cpu_ms 8api_cpu_ms 2kb Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html),gzip(gfe),gzip(gfe),gzip(gfe) 66.249.72.218 - - [16/May/2011:16:06:51 -0700] "GET /</dan%20gray/davidbanther/theoracle/marc%20erickson/matt%20hartley/intern etnut/schooltech/dannyminick/dylancombs/jfk/android/craighton/danwood/blade/ theoracle/jake%20ludington HTTP/1.1" 200 2560 - "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html),gzip(gfe),gzip(gfe),gzip(gfe)" "www.lockergnome.com" ms=13910 cpu_ms=28 api_cpu_ms=8 cpm_usd=0.001130 pending_ms=3652 throttle_code=2 -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to [email protected]. To unsubscribe from this group, send email to [email protected]. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to [email protected]. To unsubscribe from this group, send email to [email protected]. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
