Re: [Python-Dev] Googlebot and the mail.python.org python-dev archive

2009-02-28 Thread A.M. Kuchling
On Sat, Feb 28, 2009 at 09:53:10PM +1000, Nick Coghlan wrote: > Is pydotorg-www still the place for website questions?* If so, I should > probably take this over there... Just 'pydotorg' is the current list (http://mail.python.org/mailman/listinfo/pydotorg). Looking at the access logs, mail.pytho

Re: [Python-Dev] Googlebot and the mail.python.org python-dev?archive

2009-02-28 Thread A.M. Kuchling
On Sat, Feb 28, 2009 at 10:37:09AM +, Antoine Pitrou wrote: > have the following HTML tag in them: > > which explicitly instructs Web spiders *not* to index contents nor follow > links. I believe this makes spiders not index this page, but does follow links. Individual messages have "in

Re: [Python-Dev] Googlebot and the mail.python.org python-dev archive

2009-02-28 Thread Nick Coghlan
Antoine Pitrou wrote: > Georg Brandl gmx.net> writes: >> Guido van Rossum schrieb: >>> I think the better syntax would be to add site:mail.python.org to the >>> query, but you're right, that doesn't seem to find recent messages. >>> Maybe the absence of a robots.txt file on mail.python.org could b

Re: [Python-Dev] Googlebot and the mail.python.org python-dev archive

2009-02-28 Thread Georg Brandl
Guido van Rossum schrieb: > I think the better syntax would be to add site:mail.python.org to the > query, but you're right, that doesn't seem to find recent messages. > Maybe the absence of a robots.txt file on mail.python.org could be a > partial explanation? Doesn't the absence of a robots.txt

Re: [Python-Dev] Googlebot and the mail.python.org python-dev archive

2009-02-27 Thread Guido van Rossum
I think the better syntax would be to add site:mail.python.org to the query, but you're right, that doesn't seem to find recent messages. Maybe the absence of a robots.txt file on mail.python.org could be a partial explanation? (Disclaimer: I may work for Google, and Google's first crawler may hav

[Python-Dev] Googlebot and the mail.python.org python-dev archive

2009-02-27 Thread Nick Coghlan
Is anyone else having trouble getting the python.org mail archive to turn up in Google searches for python-dev messages? I prefer to use that archive rather than one of the multitude of 3rd party archives when linking posts from PEPs and tracker issues, but for the last few weeks I've had to go fi