How can I block spiders from indexing the public archives on our site?
Normally with an apache web server you can just place a robots.txt file in the root of the documents directory. Not sure how one might be able to do this with mailman.
When you take a look at the archives for a list, one sees
http://server-name/pipermail/list-name/
Since there isn't a pipermail directory, one can't just place a robots.txt file in that directory. Perhaps one could put a robots.txt file in each list directory, but that would take a lot of work with many lists and you would need to update it all the time as new lists get added.
Suggestions, clarifications, or explanations are more than welcome.
Thanks,
paulw
------------------------------------------------------ Mailman-Users mailing list [EMAIL PROTECTED] http://mail.python.org/mailman/listinfo/mailman-users Mailman FAQ: http://www.python.org/cgi-bin/faqw-mm.py Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
This message was sent to: [EMAIL PROTECTED] Unsubscribe or change your options at http://mail.python.org/mailman/options/mailman-users/archive%40jab.org
