Hello, I am running ht://Dig 3.1.6 on FreeBSD. When i am doing a rundig -v -v i can follow the indexing in the Apache server log file with the requests that htdig makes. However it appears that htdig sometimes stops making requests or the OS is preventing the request. The "not found" errors are not always from the same URI, sometimes the request is successful other times it is not. Is there a way to throttle the indexing routine?
here is an example of the output from rundig -v -v: pick: www.winbookcorp.com, # servers = 1 410:410:2:http://www.winbookcorp.com/_technote/WBTA00120140.htm: not found pick: www.winbookcorp.com, # servers = 1 411:411:2:http://www.winbookcorp.com/_technote/WBTA00120141.htm: not found pick: www.winbookcorp.com, # servers = 1 412:412:2:http://www.winbookcorp.com/_technote/WBTA00120142.htm: not found pick: www.winbookcorp.com, # servers = 1 413:413:2:http://www.winbookcorp.com/_technote/WBTA00120144.htm: not found pick: www.winbookcorp.com, # servers = 1 414:414:2:http://www.winbookcorp.com/_technote/WBTA00120145.htm: not found pick: www.winbookcorp.com, # servers = 1 415:415:2:http://www.winbookcorp.com/_technote/WBTA00120147.htm: not found pick: www.winbookcorp.com, # servers = 1 416:416:2:http://www.winbookcorp.com/_technote/WBTA00120148.htm: not found pick: www.winbookcorp.com, # servers = 1 417:417:2:http://www.winbookcorp.com/_technote/WBTA00120156.htm: not found pick: www.winbookcorp.com, # servers = 1 418:418:2:http://www.winbookcorp.com/_technote/WBTA00120157.htm: not found pick: www.winbookcorp.com, # servers = 1 419:419:2:http://www.winbookcorp.com/_technote/WBTA00120158.htm: not found pick: www.winbookcorp.com, # servers = 1 420:420:2:http://www.winbookcorp.com/_technote/WBTA00120159.htm: not found pick: www.winbookcorp.com, # servers = 1 421:421:2:http://www.winbookcorp.com/_technote/WBTA00120161.htm: not found pick: www.winbookcorp.com, # servers = 1 422:422:2:http://www.winbookcorp.com/_technote/WBTA00120163.htm: not found pick: www.winbookcorp.com, # servers = 1 423:423:2:http://www.winbookcorp.com/_technote/WBTA00120743.htm: not found pick: www.winbookcorp.com, # servers = 1 424:424:2:http://www.winbookcorp.com/_technote/WBTA00120751.htm: not found pick: www.winbookcorp.com, # servers = 1 Thanks, -ab _______________________________________________ htdig-general mailing list <[EMAIL PROTECTED]> To unsubscribe, send a message to <[EMAIL PROTECTED]> with a subject of unsubscribe FAQ: http://htdig.sourceforge.net/FAQ.html
