Hi,
I'm using nutch 0.7.
Is it possible to crawl only certain number of pages in single crawl cycle
(depth)? I looked at FetchList Tool class and I think it would be nice that
emitFetchList method had a piece of code in its main loop that woud look
something like this
if (count > MAX_PAGES_IN_CRAWL_CYCLE) {
break;
}
Thanks,
Bostjan
-------------------------------------------------------
This SF.net email is sponsored by: Splunk Inc. Do you grep through log files
for problems? Stop! Download the new AJAX search engine that makes
searching your log files as easy as surfing the web. DOWNLOAD SPLUNK!
http://sel.as-us.falkag.net/sel?cmd=lnk&kid=103432&bid=230486&dat=121642
_______________________________________________
Nutch-general mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/nutch-general
