Hi Mark,

Are you using Google's webmaster tools to inspect robots.txt? I just  
did this on a couple of my Heroku apps, and on one of them Google  
definitely read the local robots.txt file allowing it to crawl the  
app. However, I also noticed that Google hadn't refreshed any of  
these files since May 16th. Maybe you could check to see when Google  
last updated its cache for your site to see if that might explain it?

Thanks,

Morten

On May 27, 2008, at 5:56 PM, Mark wrote:

>
> Google is finding status 302 on robots.txt, however whenever I browse
> to the file I am getting 200 and the correct robots.txt.
>
> Any ideas?
> >


--~--~---------~--~----~------------~-------~--~----~
You received this message because you are subscribed to the Google Groups 
"Heroku" group.
To post to this group, send email to [email protected]
To unsubscribe from this group, send email to [EMAIL PROTECTED]
For more options, visit this group at 
http://groups.google.com/group/heroku?hl=en
-~----------~----~----~----~------~----~------~--~---

Reply via email to