According to Greg Burnham: > > i am trying to index my webserver with rundig. it is going fine until it > > comes across an Unknow host: foo.bar.com host not found. > > > > but htdig was indexing previous pages from that server. everytime i run > > rundig to index the site, it seems to stop at different places. > > > > i am totally at a loss why this is happening. anyone have suggestions for me? > > Have you tried setting server_wait_time in the conf file? Maybe your > server is being overloaded and stops responding. Is there any > indication in the servers logs? > > http://htdig.org/attrs.html#server_wait_time
Yes, that's certainly worth a try. We also never got any feedback from you last week about the possibility of the problem being caused by an overloaded name server, or a connection that's too slow between your system and its name server. Either of these problems may or may not be helped by server_wait_time, depending on whether htdig or other activity is the major cause of the slow name server response. If htdig is having problems reaching the name server, that would certainly cause those "Unknown host" errors. I mentioned that last week, so I'm not sure why you still say you're "totally at a loss why this is happening." What is the name server for your htdig system? Is it on your local net, or on a remote network? Is it shared by lots of other systems, and perhaps overloaded? Is there any possibility of using a closer and/or less busy name server for your system, or setting up a caching-only DNS server? -- Gilles R. Detillieux E-mail: <[EMAIL PROTECTED]> Spinal Cord Research Centre WWW: http://www.scrc.umanitoba.ca/ Dept. Physiology, U. of Manitoba Winnipeg, MB R3E 3J7 (Canada) _______________________________________________________________ Don't miss the 2002 Sprint PCS Application Developer's Conference August 25-28 in Las Vegas -- http://devcon.sprintpcs.com/adp/index.cfm _______________________________________________ htdig-general mailing list <[EMAIL PROTECTED]> To unsubscribe, send a message to <[EMAIL PROTECTED]> with a subject of unsubscribe FAQ: http://htdig.sourceforge.net/FAQ.html

