Hi,

I've patched the module mod_autoindex (the automatic generation of 
dirlistings where no index file exists) to generate a robots META tag.
Apache now generates as listings code:

...
<HTML>
 <HEAD>
 <META name="robots" content="noindex,follow">
 <TITLE>Index of /data/IT-development</TITLE>
 </HEAD>
 <BODY>
...
<IMG SRC="/icons/back.gif" ALT="[DIR]"> <A HREF="/data/">Parent
Directory</A>
<IMG SRC="/icons/text.gif" ALT="[TXT]"> <A HREF="test.txt">test.txt</A>

...
</BODY></HTML>


I had hoped this would stop the indexing of the dir-listings, and
indeed it does, but it also stops indexing of the file test.txt
and this I don't want.

Is this a bug in htdig-3.1.5?

Regards,

Henk Vergonet


------------------------------------
To unsubscribe from the htdig mailing list, send a message to
[EMAIL PROTECTED]
You will receive a message to confirm this.

Reply via email to