Shuffling takes too long to get the last map output.
----------------------------------------------------
Key: HADOOP-3130
URL: https://issues.apache.org/jira/browse/HADOOP-3130
Project: Hadoop Core
Issue Type: Bug
Reporter: Runping Qi
I noticed that towards the end of shufflling, the map output fetcher of the
reducer backs off too aggressively.
I attach a fraction of one reduce log of my job.
Noticed that the last map output was not fetched in 2 minutes.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.