At 12:46 PM -0400 10/23/00, [EMAIL PROTECTED] wrote:
>Looking at the main digging loop, I am having some trouble figuring out what
>is going on. Does server->pop() return null if the server fails to respond
>for one document? It looks like if that happens, more will never be set back
>to 1. Is that why one retrieval failure ruins the whole rest of the dig?
Just as a FYI here, server->pop() will only return null if there
aren't any more URLs to be indexed--at that point indexing will stop
for that server entirely.
What you were seeing was something different--there were URLs still
on the pile to be indexed, but the server was marked as dead.
--
-Geoff Hutchison
Williams Students Online
http://wso.williams.edu/
------------------------------------
To unsubscribe from the htdig mailing list, send a message to
[EMAIL PROTECTED]
You will receive a message to confirm this.
List archives: <http://www.htdig.org/mail/menu.html>
FAQ: <http://www.htdig.org/FAQ.html>