On Sat, Feb 28, 2009 at 10:37:09AM +0000, Antoine Pitrou wrote: > have the following HTML tag in them: > <META NAME="robots" CONTENT="noindex,follow"> > which explicitly instructs Web spiders *not* to index contents nor follow > links.
I believe this makes spiders not index this page, but does follow links. Individual messages have "index,nofollow". --amk _______________________________________________ Python-Dev mailing list Python-Dev@python.org http://mail.python.org/mailman/listinfo/python-dev Unsubscribe: http://mail.python.org/mailman/options/python-dev/archive%40mail-archive.com
