[EMAIL PROTECTED] writes:
> On 16 Jun, Michael Graff wrote:
> > Is there any reasonable way to do this?
> >
> > (1) index a group of sites.
> > (2) nightly, re-index them, updating the current database as
> > needed.
> > (3) keep searches up and running while the indexing is taking
> > place.
> > (4) not keep 2 copies of the database. It is already large.
> >
> > --Michael
>
> Short answer: the -a argument to htdig
This breaks (2) though -- it doesn't update the database, it totally
refetches every page. I'm going to be indexing well over 50,000
pages. Closer to 75,000 I suspect.
Yes, I could keep the old files around, but that seems like such a waste.
--Michael
----------------------------------------------------------------------
To unsubscribe from the htdig mailing list, send a message to
[EMAIL PROTECTED] containing the single word "unsubscribe" in
the body of the message.
