Re: [Python-Dev] Googlebot and the mail.python.org python-dev archive

2009-02-28 Thread A.M. Kuchling
On Sat, Feb 28, 2009 at 09:53:10PM +1000, Nick Coghlan wrote: > Is pydotorg-www still the place for website questions?* If so, I should > probably take this over there... Just 'pydotorg' is the current list (http://mail.python.org/mailman/listinfo/pydotorg). Looking at the access logs, mail.pytho

Re: [Python-Dev] Googlebot and the mail.python.org python-dev?archive

2009-02-28 Thread A.M. Kuchling
On Sat, Feb 28, 2009 at 10:37:09AM +, Antoine Pitrou wrote: > have the following HTML tag in them: > > which explicitly instructs Web spiders *not* to index contents nor follow > links. I believe this makes spiders not index this page, but does follow links. Individual messages have "in

Re: [Python-Dev] Googlebot and the mail.python.org python-dev archive

2009-02-28 Thread Nick Coghlan
Antoine Pitrou wrote: > Georg Brandl gmx.net> writes: >> Guido van Rossum schrieb: >>> I think the better syntax would be to add site:mail.python.org to the >>> query, but you're right, that doesn't seem to find recent messages. >>> Maybe the absence of a robots.txt file on mail.python.org could b

Re: [Python-Dev] Googlebot and the mail.python.org python-dev archive

2009-02-28 Thread Georg Brandl
Guido van Rossum schrieb: > I think the better syntax would be to add site:mail.python.org to the > query, but you're right, that doesn't seem to find recent messages. > Maybe the absence of a robots.txt file on mail.python.org could be a > partial explanation? Doesn't the absence of a robots.txt

Re: [Python-Dev] Googlebot and the mail.python.org python-dev archive

2009-02-27 Thread Guido van Rossum
I think the better syntax would be to add site:mail.python.org to the query, but you're right, that doesn't seem to find recent messages. Maybe the absence of a robots.txt file on mail.python.org could be a partial explanation? (Disclaimer: I may work for Google, and Google's first crawler may hav