On Fri, 17 Dec 1999, Paul Johnson wrote:
> Q: How can I prevent htdig's index from including files like index.html
> that are automatically found by the web browser when doing a crawl over
> a directory structure.
>
> A: In each index.html file you want to exclude, add the following
> between the <HEAD> and </HEAD> tags:
>
> <META NAME="robots" CONTENT="noindex, follow">
>
> The insertion of this line can be made automatic in MhonArc by inserting
> that line in the resource file in the sections IDXPGBEGIN and
> TIDXPGBEGIN
Fair enough, we'll hopefully include it in the FAQ soon. (I'm home for
the holidays and can't edit things very well :-)
-Geoff Hutchison
Williams Students Online
http://wso.williams.edu/
------------------------------------
To unsubscribe from the htdig mailing list, send a message to
[EMAIL PROTECTED]
You will receive a message to confirm this.
