At 5:17 PM -0800 3/5/01, Ian Lipsky wrote:
>say i have www.somesite.com/page.html and page.html has links on it
>to 10 other sites. I would want htdig to crawl those 10 other sites,
>but only crawl them to a depth of say 3 links off my start page.
Yes and no. You can easily set a start_url and go 3 "hops" or
whatever from the start_urls with the max_hop_count attribute:
<http://www.htdig.org/attrs.html#max_hop_count>
But as has been recently discussed on another thread, it's not really
possible to say "index this site and go one hop off all pages on this
server."
--
--
-Geoff Hutchison
Williams Students Online
http://wso.williams.edu/
_______________________________________________
htdig-general mailing list <[EMAIL PROTECTED]>
To unsubscribe, send a message to <[EMAIL PROTECTED]> with a
subject of unsubscribe
FAQ: http://htdig.sourceforge.net/FAQ.html
