Author: ddas
Date: Mon Mar 16 16:19:57 2009
New Revision: 754927
URL: http://svn.apache.org/viewvc?rev=754927&view=rev
Log:
HADOOP-5493. The shuffle copier threads return the codecs back to the pool when
the shuffle completes. Contributed by Jothi Padmanabhan.
Modified:
hadoop/core/trunk/CHANGES.txt
hadoop/core/trunk/src/mapred/org/apache/hadoop/mapred/ReduceTask.java
Modified: hadoop/core/trunk/CHANGES.txt
URL:
http://svn.apache.org/viewvc/hadoop/core/trunk/CHANGES.txt?rev=754927&r1=754926&r2=754927&view=diff
==============================================================================
--- hadoop/core/trunk/CHANGES.txt (original)
+++ hadoop/core/trunk/CHANGES.txt Mon Mar 16 16:19:57 2009
@@ -1001,6 +1001,9 @@
HADOOP-5490. Fixes a synchronization problem in the
EagerTaskInitializationListener
class. (Jothi Padmanabhan via ddas)
+ HADOOP-5493. The shuffle copier threads return the codecs back to the pool
when the
+ shuffle completes. (Jothi Padmanabhan via ddas)
+
Release 0.19.2 - Unreleased
BUG FIXES
Modified: hadoop/core/trunk/src/mapred/org/apache/hadoop/mapred/ReduceTask.java
URL:
http://svn.apache.org/viewvc/hadoop/core/trunk/src/mapred/org/apache/hadoop/mapred/ReduceTask.java?rev=754927&r1=754926&r2=754927&view=diff
==============================================================================
--- hadoop/core/trunk/src/mapred/org/apache/hadoop/mapred/ReduceTask.java
(original)
+++ hadoop/core/trunk/src/mapred/org/apache/hadoop/mapred/ReduceTask.java Mon
Mar 16 16:19:57 2009
@@ -1238,7 +1238,7 @@
finish(size, error);
}
} catch (InterruptedException e) {
- return; // ALL DONE
+ break; // ALL DONE
} catch (FSError e) {
LOG.error("Task: " + reduceTask.getTaskID() + " - FSError: " +
StringUtils.stringifyException(e));
@@ -1253,6 +1253,11 @@
StringUtils.stringifyException(th));
}
}
+
+ if (decompressor != null) {
+ CodecPool.returnDecompressor(decompressor);
+ }
+
}
/** Copies a a map output from a remote host, via HTTP.
