Patches item #445457, was opened at 2001-07-28 04:01 You can respond by visiting: http://sourceforge.net/tracker/?func=detail&atid=304593&aid=445457&group_id=4593 Category: devel Group: None Status: Open Resolution: None Priority: 5 Submitted By: Gaspar Chilingarov (nightmar) Assigned to: Nobody/Anonymous (nobody) Summary: Delaed retrieval of robots.txt Initial Comment: This patch allows to delay loading of "robots.txt" file from the server until first connection really made to the server - the main purpose of this to decrease startup time for htdig - in case of multiple domains, which are located on slow links or in case of some servers are down :) this gives great startup speed boost for me, YMMV. please apply patch in htdig directory ... ---------------------------------------------------------------------- You can respond by visiting: http://sourceforge.net/tracker/?func=detail&atid=304593&aid=445457&group_id=4593 _______________________________________________ htdig-dev mailing list [EMAIL PROTECTED] http://lists.sourceforge.net/lists/listinfo/htdig-dev
