Shuffle should be broken down to only two phases (copy/reduce) instead of three
(copy/sort/reduce)
--------------------------------------------------------------------------------------------------
Key: MAPREDUCE-956
URL: https://issues.apache.org/jira/browse/MAPREDUCE-956
Project: Hadoop Map/Reduce
Issue Type: Bug
Reporter: Jothi Padmanabhan
For the progress calculations and displaying on the UI, shuffle, in its current
form, is decomposed into three phases (copy/sort/reduce). Actually, the sort
phase is no longer applicable. I think we should just reduce the number of
phases to two and assign 50% weight-age to each of copy and reduce phases.
Thoughts?
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.