Reduce progress in the Reducer crosses 1
----------------------------------------
Key: HADOOP-4000
URL: https://issues.apache.org/jira/browse/HADOOP-4000
Project: Hadoop Core
Issue Type: Bug
Components: mapred
Reporter: Amar Kamat
I printed the progress in the {{Progress.java}} for every progress made and I
found this scenario
{noformat}
update called for reduce with progress 0.99998355
update called for reduce with progress 0.99998355
update called for reduce with progress 1.0000043
update called for reduce with progress 1.0000043
update called for reduce with progress 1.0000244
{noformat}
Following are the lines I added to get this
{code:title=Progress.java|borderStyle=solid}
/** Called during execution on a leaf node to set its progress. */
public synchronized void set(float progress) {
System.out.println("update called for " + status + " with progress " +
progress);
this.progress = progress;
}
{code}
This needs investigation and will also explain why occasionally users see jobs
that are complete and their progress less that 100%.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.