Ok, I agree that must have had an impact but how do you explain one month down to "almost" zero when my headers were sent by gae ?
On Sun, Sep 11, 2011 at 9:13 PM, Brandon Wirtz <[email protected]> wrote: > Your crawl rate changed because the Headers for serving changed from GAE to > CF In a Week they will be back to normal.**** > > ** ** > > ** ** > > *From:* [email protected] [mailto: > [email protected]] *On Behalf Of *Roch Delsalle > *Sent:* Sunday, September 11, 2011 5:02 AM > > *To:* [email protected] > *Subject:* [google-appengine] Re: Google Bot Is Your Enemy**** > > ** ** > > Here is what I noticied : > http://www.d-ro.ch/2011/09/appengine-cloudflare-crawlrate**** > > Anyway you shouldn't block Googlebot that would de-index you form google.* > *** > > -- > You received this message because you are subscribed to the Google Groups > "Google App Engine" group. > To view this discussion on the web visit > https://groups.google.com/d/msg/google-appengine/-/ah8AAXrX-kMJ. > To post to this group, send email to [email protected]. > To unsubscribe from this group, send email to > [email protected]. > For more options, visit this group at > http://groups.google.com/group/google-appengine?hl=en.**** > > -- > You received this message because you are subscribed to the Google Groups > "Google App Engine" group. > To post to this group, send email to [email protected]. > To unsubscribe from this group, send email to > [email protected]. > For more options, visit this group at > http://groups.google.com/group/google-appengine?hl=en. > -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to [email protected]. To unsubscribe from this group, send email to [email protected]. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
