When you run multiple commands within nutch it seems to process the
pending tasks in the order that they were added to the queue.  In some
cases this means you may be 50% through many jobs (complete map but not
reduce) while processes maps for yet more jobs.

I think Nutch should prioritize a pending reduce before a pending map as
it keeps things going through (other processes may depend on the
results) and allows temporary diskspace to be freed.
-- 
Rod Taylor <[EMAIL PROTECTED]>



-------------------------------------------------------
This SF.net email is sponsored by: Splunk Inc. Do you grep through log files
for problems?  Stop!  Download the new AJAX search engine that makes
searching your log files as easy as surfing the  web.  DOWNLOAD SPLUNK!
http://ads.osdn.com/?ad_id=7637&alloc_id=16865&op=click
_______________________________________________
Nutch-developers mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/nutch-developers

Reply via email to