According to Gabriele Bartolini: > We successfully tested all the HTTP protocol related attributes, > except ignore_dead_servers: indeed, we have not seen any difference in > switching it off/on as when we try to index a host that does not exist, > robots.txt retrieval fails and no other document gets fetched from that > server anyway. Please have a look at it if you can. This means that the > test is now 95% completed.
OK, this sounds potentially serious! Were you using the latest CVS code or the 3.2.0b5 release? I don't see anything in the code right now that would cause this to happen, but if it definitely is, we need to dig deeper. Are you sure that htdig will not attempt to try again when ignore_dead_servers is true, after fetching robots.txt has failed? Is it the same behaviour whether the host does not exist (no DNS entry for it) vs. if it exists but is down? -- Gilles R. Detillieux E-mail: <[EMAIL PROTECTED]> Spinal Cord Research Centre WWW: http://www.scrc.umanitoba.ca/ Dept. Physiology, U. of Manitoba Winnipeg, MB R3E 3J7 (Canada) ------------------------------------------------------- The SF.Net email is sponsored by EclipseCon 2004 Premiere Conference on Open Tools Development and Integration See the breadth of Eclipse activity. February 3-5 in Anaheim, CA. http://www.eclipsecon.org/osdn _______________________________________________ ht://Dig Developer mailing list: [EMAIL PROTECTED] List information (subscribe/unsubscribe, etc.) https://lists.sourceforge.net/lists/listinfo/htdig-dev
