At 3:16 PM -0800 1/18/00, John Caldwell wrote:
>On occasion there may be a page removed, and I figured the logical way to
>remove the page from the db would be to have the spider get a 404 when it
>went to the specified page. I tried this with a few of the pages in the
>database, and when merging it notes that it wasn't found, but doesn't
>actually remove it from the main db. Is there any way to do this? Since
>the number of documents could potentially get quite large (about 250-500
>added per day) I sure would hate to have to reindex the whole thing!
If you've set remove_bad_urls, then a 404 will remove it.
http://www.htdig.org/attrs.html#remove_bad_urls
We're aware that removing URLs is more difficult than it should be.
-Geoff Hutchison
Williams Students Online
http://wso.williams.edu/
------------------------------------
To unsubscribe from the htdig mailing list, send a message to
[EMAIL PROTECTED]
You will receive a message to confirm this.
