> Why htdig seems to ignore robots.txt entries? ht://Dig follows the Standard for Robots Exclusions. You may find useful these links:
http://www.it.htdig.org/FAQ.html#q4.22 http://www.it.htdig.org/attrs.html#robotstxt_name Ciao -Gabriele -- Gabriele Bartolini - Web Programmer Comune di Prato - Prato - Tuscany - Italy [EMAIL PROTECTED] | http://www.comune.prato.it > find bin/laden -name osama -exec rm {} ;
signature.asc
Description: PGP signature
