In ReduceTask::fetchOutputs, wait for result can be improved slightly
---------------------------------------------------------------------
Key: HADOOP-3427
URL: https://issues.apache.org/jira/browse/HADOOP-3427
Project: Hadoop Core
Issue Type: Bug
Components: mapred
Reporter: Devaraj Das
Assignee: Devaraj Das
Fix For: 0.18.0
The getCopyResult call in ReduceTask::fetchOutputs waits for 2 seconds if the
results list is empty. This can be improved to wait only when sufficient number
of fetches (above a certain threshold) have been scheduled. The threshold
should ensure that all the fetcher threads would be busy enough, and in this
case, the call to getCopyResult would return only when a fetcher thread wakes
it up.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
