On Sep 4, 2008, at 12:48 PM, Tarandeep Singh wrote:
Can I stop Map-Reduce jobs after mappers (or reducers) have produced N records ?
You could do this pretty easily by implementing a custom MapRunnable. There is no equivalent for reduces. The interface proposed in HADOOP-1230 would support that kind of application. See:
http://svn.apache.org/repos/asf/hadoop/core/trunk/src/mapred/org/apache/hadoop/mapreduce/ Look at the new Mapper and Reducer interfaces. -- Owen
