SuYan created MAPREDUCE-6912:
--------------------------------
Summary: CompletedMapTask contains failed and killed will lead
mapreduce.job.reduce.slowstart.completedmaps not work properly
Key: MAPREDUCE-6912
URL: https://issues.apache.org/jira/browse/MAPREDUCE-6912
Project: Hadoop Map/Reduce
Issue Type: Bug
Reporter: SuYan
if the conf is set to 1, is about to make reduce task to be scheduled only
after all map task success
{code}
int completedMapsForReduceSlowstart = (int)Math.ceil(reduceSlowStart *
totalMaps);
if(completedMaps < completedMapsForReduceSlowstart) {}
///////////////////////////
int completedMaps = getJob().getCompletedMaps();
///////////////////////////
JobImpl
@Override
public int getCompletedMaps() {
readLock.lock();
try {
return succeededMapTaskCount + failedMapTaskCount + killedMapTaskCount;
} finally {
readLock.unlock();
}
}
{code}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: mapreduce-dev-h...@hadoop.apache.org
