On Thu, 10 Jun 1999, Lee Lavoy wrote:
> I am digging exactly the same document group, and I've been
> reading that the dbs should be smaller now. While there wasn't a
Yes and no. Many bugs with indexing documents have been fixed along the
way. Many of these bugs either prevented documents from being indexed in
the first place (I'm sure people on the list may remember the thread about
documents that were rejected for no obvious reason) or prevented documents
from being indexed fully.
> max_doc_size attribute in 3.1.0b2, very few of my directories are
> large and my files tend to be small -- so that seems unrelated.
> The only other change that I did at the same time was to upgrade
> to Apache 1.3.6 and add mod_ssl. Can't see that having an effect.
Max_doc_size was in 3.1.0b2, but it was added to the default htdig.conf
file because there were so many FAQs about it. Remember that just because
it isn't in the conf, doesn't mean you can't set it. :-)
> also that it took about 6 hr. to dig this time versus 1 hr., 45
> min. previously (I'm using local_urls, running on
> Linux2.0.36,P150/96MB RAM).
I wouldn't worry about speed for htsearch. Since I think you were the
author of one of those message threads about documents not being indexed
in the betas, I'd prefer much *more* that all the documents that are
supposed to be there are *really* there. We're working on speed quite a
bit in the 3.2 code.
As far as the digging speed, I know you have a lot of documents, but I'm
wondering why it's taking 6 hours using local_urls. How much does it still
hit the webserver? Have you set local_default_doc?
-Geoff Hutchison
Williams Students Online
http://wso.williams.edu/
------------------------------------
To unsubscribe from the htdig mailing list, send a message to
[EMAIL PROTECTED] containing the single word "unsubscribe" in
the SUBJECT of the message.
