At 9:51 AM +0200 8/20/01, [EMAIL PROTECTED] wrote:
>If I run htdig with serverwait_time=0 (standard value), htdig does it job in
>about 1 and 1,5 hour. So far so god, but after this, when I'm searching in
>my database, a lot of site are missing. In the log I saw that several servers
>were not digged, in the log-file was something written like "New server:
>basis.shacknet.nu no server running". According to this I've set the
>serverwait_time=1, because I read somewhere this could solve the problem.
Certainly indexing can be done at such a rate as to saturate network
connections or bump the limit of the number of server processes
available, etc. There may also be issues between the proxy and the
htdig indexing (which would be good to know so we can fix them).
>because all the sites to dig are on the local machine. How can I speed up?
This is easy. See the various local_url attributes...
<http://www.htdig.org/attrs.html#local_urls>
If you index directly over the filesystem, you'll avoid HTTP and
proxy issues all together.
--
--
-Geoff Hutchison
Williams Students Online
http://wso.williams.edu/
_______________________________________________
htdig-general mailing list <[EMAIL PROTECTED]>
To unsubscribe, send a message to <[EMAIL PROTECTED]> with a
subject of unsubscribe
FAQ: http://htdig.sourceforge.net/FAQ.html
