Move the call to getMapCompletionEvents in ReduceTask.ReduceCopier.fetchOutputs
to a separate thread
----------------------------------------------------------------------------------------------------
Key: HADOOP-4683
URL: https://issues.apache.org/jira/browse/HADOOP-4683
Project: Hadoop Core
Issue Type: Bug
Components: mapred
Reporter: Devaraj Das
Fix For: 0.20.0
The method ReduceTask.ReduceCopier.fetchOutputs makes a call to
getMapCompletionEvents every iteration of the loop. This should be moved out to
a separate thread. This might slow down the shuffle scheduler in some cases
since there is a sleep inside the getMapCompletionEvents method.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
