>(1) Obviously, we can automatically generate a config file that
>lists thousands of start URLs. Will this create performance
>problems, i.e., does it take significantly longer to dig though
>thousands of small shrubs, than through a few huge trees? Is
>this kind of use intended?
Yes, depending on RAM availability. Yes, it is intended. A quick
explanation is probably helpful here--in the case of a "few huge
trees," the number of URLs on the priority list tends to be smaller
than when you have thousands of small shrubs. So in terms of resource
use, it's easier to dig through a few huge trees. But if you have a
fair amount of RAM, it won't make much difference either way.
>(2) Has anyone used htdig in this fashion?
Yes, plenty of people.
>(4) Intuitively, this is a conern only for htdig, not htmerge or
>htsearch. Is there any reason I should question this intuition?
No, this is correct. It's only an issue at indexing time.
Cheers,
--
--
-Geoff Hutchison
Williams Students Online
http://wso.williams.edu/
_______________________________________________
htdig-general mailing list <[EMAIL PROTECTED]>
To unsubscribe, send a message to <[EMAIL PROTECTED]> with a
subject of unsubscribe
FAQ: http://htdig.sourceforge.net/FAQ.html
