Geoff Hutchison wrote:
>
> On Wed, 26 Jul 2000, Gilles Detillieux wrote:
>
> > According to [EMAIL PROTECTED]:
> > > Now I have to investigate why certain pages are flagged as
> > > "Deleted, noexcerpt"!
> >
> > Main causes:
> > - disallowed in robots.txt
> > - indexing turned off by meta robots or noindex tags
> > - no indexable text in documents
> > - server_max_docs exceeded
>
> Also when merging:
> - duplicates between the two databases (oldest is removed)
Ah! That last might explain a lot of them. Any chance of more helpful
messages in a future version, eg: "Deleted, duplicate:" ?
If "indexing turned off by meta robots or noindex tags" results in
"Deleted, noexcerpt", what condition gives the message "Deleted, noindex:" ?
--
David J Adams
<[EMAIL PROTECTED]>
Computing Services
University of Southampton
------------------------------------
To unsubscribe from the htdig mailing list, send a message to
[EMAIL PROTECTED]
You will receive a message to confirm this.
