Hi Larry, It could have just been a temporary error, maybe you can try manually checking the robots.txt to see if there are any problems? https://www.google.com/support/webmasters/bin/answer.py?answer=35237&query=robots.txt&topic=&type=
-Marzia On Wed, Dec 3, 2008 at 8:03 AM, Larry <[EMAIL PROTECTED]> wrote: > > Hi! > > I have submitted my application and am tracking progress with Google > Webmaster but many of the URLs that it tries to index have errors. The > errors are all the same and of the type "robots.txt file unreachable" > as described here: > > > https://www.google.com/support/webmasters/bin/answer.py?answer=35147&ctx=tltp&hl=en > > The thing that is confusing me is that robots.txt is quite accessible > for me by the URL: > > http://silicon.appspot.com/robots.txt > > However, obviously Google can't seem to understand it or something! > The relevant part of my app.yaml file is pasted below. I would of > thought that is adequate and correct but perhaps not? > > - url: /robots.txt > static_files: scripts/robots.txt > upload: scripts/robots.txt > > My only idea as to what is going wrong, is that AppEngine is blocking > GoogleBot. Is this likely; or am I doing something wrong? > > Thanks, > Larry > > > --~--~---------~--~----~------------~-------~--~----~ You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to [email protected] To unsubscribe from this group, send email to [EMAIL PROTECTED] For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~----------~----~----~----~------~----~------~--~---
