Re: [Pound Mailing List] Blocking spambots

[Mike Slinn]

robots.txt is only honored by the good guys. For bad guys, robots.txt 
provides a list of places that they know you don't want them to look at.
Also, if pound blocks the bad guys, the web server won't have to handle 
those requests, which can present a significant load.

--
To unsubscribe send an email with subject unsubscribe to pound@apsis.ch.
Please contact ro...@apsis.ch for questions.