On Feb 16, 1:51 pm, GA wrote:
> if you permit u=http in your robots.txt file, the AdSense crawler is
> allowed to crawl and the error message should 
> disappear.http://translate.googleusercontent.com/robots.txt

We correctly block robots.txt from crawling our translations of
webpages.  We don't want web crawlers to try to crawl complete
translations of the web through our service ;-)

Cheers,
Josh

Reply via email to