Nick Coghlan gmail.com> writes:
>
> >
> > which explicitly instructs Web spiders *not* to index contents nor follow
links.
>
> That's not quite true - that meta tag says not to index the current
> page, but *do* follow the links to other pages. The archive page and the
> monthly summary pa
Georg Brandl gmx.net> writes:
>
> Guido van Rossum schrieb:
> > I think the better syntax would be to add site:mail.python.org to the
> > query, but you're right, that doesn't seem to find recent messages.
> > Maybe the absence of a robots.txt file on mail.python.org could be a
> > partial explan
