While we're on web servers, I came across this today - worth checking out? Its about blocking robots that ignore robots exclusion stuff at the web server level.
http://diveintomark.org/archives/2003/02/26/how_to_block_spambots_ban_spybot s_and_tell_unwanted_robots_to_go_to_hell.html Deals mostly with Apache mod_rewrite but also has a link to doing the equivalent on IIS. Unfortunately for IIS you need to script the whole thing in ASP or I guess you could use CF or whatever else, but I like how Apache allows you to do it at the web server level so its can cover any/all mime types. Cheers Mark ______________ Mark Stanton Web Production Gruden Pty Ltd Tel: 9956 6388 Mob: 0410 458 201 Fax: 9956 8433 www.gruden.com --- You are currently subscribed to cfaussie as: [EMAIL PROTECTED] To unsubscribe send a blank email to [EMAIL PROTECTED] MX Downunder AsiaPac DevCon - http://mxdu.com/
