Author: cutting
Date: Tue Jun 26 13:30:40 2007
New Revision: 550932
URL: http://svn.apache.org/viewvc?view=rev&rev=550932
Log:
HADOOP-1514. Make reducers report progress while waiting for map output, so
they're not killed. Contributed by Vivek.
Modified:
lucene/hadoop/trunk/CHANGES.txt
lucene/hadoop/trunk/src/java/org/apache/hadoop/mapred/ReduceTask.java
Modified: lucene/hadoop/trunk/CHANGES.txt
URL:
http://svn.apache.org/viewvc/lucene/hadoop/trunk/CHANGES.txt?view=diff&rev=550932&r1=550931&r2=550932
==============================================================================
--- lucene/hadoop/trunk/CHANGES.txt (original)
+++ lucene/hadoop/trunk/CHANGES.txt Tue Jun 26 13:30:40 2007
@@ -254,6 +254,9 @@
77. HADOOP-1515. Add MultiFileInputFormat, which can pack multiple,
typically small, input files into each split. (Enis Soztutar via cutting)
+ 78. HADOOP-1514. Make reducers report progress while waiting for map
+ outputs, so they're not killed. (Vivek Ratan via cutting)
+
Release 0.13.0 - 2007-06-08
Modified: lucene/hadoop/trunk/src/java/org/apache/hadoop/mapred/ReduceTask.java
URL:
http://svn.apache.org/viewvc/lucene/hadoop/trunk/src/java/org/apache/hadoop/mapred/ReduceTask.java?view=diff&rev=550932&r1=550931&r2=550932
==============================================================================
--- lucene/hadoop/trunk/src/java/org/apache/hadoop/mapred/ReduceTask.java
(original)
+++ lucene/hadoop/trunk/src/java/org/apache/hadoop/mapred/ReduceTask.java Tue
Jun 26 13:30:40 2007
@@ -872,6 +872,9 @@
// new, just wait for a bit
try {
if (numInFlight == 0 && numScheduled == 0) {
+ // we should indicate progress as we don't want TT to think
+ // we're stuck and kill us
+ reporter.progress();
Thread.sleep(5000);
}
} catch (InterruptedException e) { } // IGNORE
