Shuffle deadlocks on wrong number of maps
-----------------------------------------
Key: MAPREDUCE-1252
URL: https://issues.apache.org/jira/browse/MAPREDUCE-1252
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: task
Affects Versions: 0.21.0, 0.22.0
Reporter: Owen O'Malley
Assignee: Owen O'Malley
Priority: Blocker
Fix For: 0.21.0, 0.22.0
Attachments: mr-1252.patch
The new shuffle assumes that the number of maps is correct. The new
JobSubmitter sets the old value. Something misfires in the middle causing:
09/12/01 00:00:15 WARN conf.Configuration: mapred.job.split.file is deprecated.
Instead, use mapreduce.job.splitfile
09/12/01 00:00:15 WARN conf.Configuration: mapred.map.tasks is deprecated.
Instead, use mapreduce.job.maps
But my reduces got stuck at 2 maps / 12 when there were only 2 maps in the job.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
