With the apache configuration reported earlier by Jarno, the pages generated by the autoindex module do indeed contain the expected metatag for robots, only htdig seems not to obey it.
$ cat /var/www/html/autoindex.html <!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 3.2 Final//EN"> <html> <head> <title>Index</title> <meta NAME="robots" CONTENTS="noindex, follow"> </head> <body> <h1>Index</h1> $ lynx -source http://esccweb1.ntc.nokia.com/htdig_sltest/ <!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 3.2 Final//EN"> <html> <head> <title>Index</title> <meta NAME="robots" CONTENTS="noindex, follow"> </head> <body> <h1>Index</h1> <pre><img src="/icons/blank.gif" alt="Icon " /> <a href="?C=N&O=D">Name</a> <a href="?C=M&O=A">Last modified</a> <a href="?C=S&O=A">Size</a> <a href="?C=D&O=A">Description</a><hr /><img src="/icons/back.gif" alt="[DIR]" /> <a href="/">Parent Directory</a> - <img src="/icons/folder.gif" alt="[DIR]" /> <a href="sl/">sl/</a> 04-Mar-2003 11:59 - <img src="/icons/text.gif" alt="[TXT]" /> <a href="test_gcs_tnx.html">test_gcs_tnx.html</a> 26-Feb-2003 09:26 1.0K <hr /></pre> </body></html> $ >>>>> "JL" == Jarno Laitinen <[EMAIL PROTECTED]> writes: JL> -httpd.conf- JL> ... JL> <Directory "/var/www/html"> JL> # JL> Options Indexes FollowSymLinks MultiViews JL> ... JL> Alias /htdig_sltest/ "/home/laitijar/test/" JL> <Directory "/home/laitijar/test"> JL> Options FollowSymLinks Indexes MultiViews JL> AllowOverride None JL> Order allow,deny JL> Allow from all JL> </Directory> JL> ... JL> IndexOptions SuppressHTMLPreamble FancyIndexing VersionSort NameWidth=* JL> ... JL> HeaderName /autoindex-header.html JL> ... Why? Best Regards! Marc -- Marc Girod 313 Fairchild Drive desk: +1 650 864 6501 Nokia NBI CA 94043 Mountain View mobile: +1 817 703 8975 cube #314 USA fax: +1 650 691 ------------------------------------------------------- This SF.net email is sponsored by:Crypto Challenge is now open! Get cracking and register here for some mind boggling fun and the chance of winning an Apple iPod: http://ads.sourceforge.net/cgi-bin/redirect.pl?thaw0031en _______________________________________________ htdig-general mailing list <[EMAIL PROTECTED]> To unsubscribe, send a message to <[EMAIL PROTECTED]> with a subject of unsubscribe FAQ: http://htdig.sourceforge.net/FAQ.html
