On Wed, 26 Jul 2000, Gilles Detillieux wrote:
> According to [EMAIL PROTECTED]:
> > Now I have to investigate why certain pages are flagged as
> > "Deleted, noexcerpt"!
>
> Main causes:
> - disallowed in robots.txt
> - indexing turned off by meta robots or noindex tags
> - no indexable text in documents
> - server_max_docs exceeded
Also when merging:
- duplicates between the two databases (oldest is removed)
--
-Geoff Hutchison
Williams Students Online
http://wso.williams.edu/
------------------------------------
To unsubscribe from the htdig mailing list, send a message to
[EMAIL PROTECTED]
You will receive a message to confirm this.
