Hello, I have noticed that this questions has come up on this list a few times in the past. Unfortunately, I was not able to find an answer that solved my problem. I am hoping that someone on the list can help me trouble shoot this.
I am running ht://Dig 3.1.5 on a FreeBSD 4.4 box, and am using it to index local documents served by Apache 1.3.22. Whenever running a Dig session, at some arbitrary point, Htdig is unable to build a connection with the server, and all the following documents to be spidered are reported as "no server running." (see below) I have tried several of the recommendations found on the list: running the dig session with a server_wait_time of 8+, mapping the files with local_urls. Unfortunately, they seem to have all failed. A large portion of the documents are PHP files, so the dig session is forced to connect to Apache to retrieve them. Would there perhaps be some tweaks to Apache that would enable it to better deal with a Htdig crawl? Or perhaps a way to get Htdig to "take a break" if it unable to build a connection to the server, and then try again after? Thank you for your help, Michael Caplan Institute for Social Ecology http://www.social-ecology.org/ 1118 Maple Hill Road Plainfield, VT, 05667 USA Tel.: 1 (514) 421-3515 General Tel. / Fax.: 1 (802) 454-8493 1155:843:1:http://www.social-ecology.org/harbinger/vol2no1/education_2.html: not changed 1156:410:1:http://www.social-ecology.org/harbinger/vol2no1/hungry.html: not changed 1157:409:1:http://www.social-ecology.org/harbinger/vol2no1/name.html: Unable to build connection with www.social-ecology.org:80 no server running 1158:408:1:http://www.social-ecology.org/harbinger/vol2no1/oromo.html: no server running 1159:407:1:http://www.social-ecology.org/harbinger/vol2no1/prefigurative.htm l: no server running 1160:406:1:http://www.social-ecology.org/harbinger/vol2no1/radicalizing.html : no server running _______________________________________________ htdig-general mailing list <[EMAIL PROTECTED]> To unsubscribe, send a message to <[EMAIL PROTECTED]> with a subject of unsubscribe FAQ: http://htdig.sourceforge.net/FAQ.html
