Jobtracker should report 99% until the query is done.
-----------------------------------------------------

                 Key: MAPREDUCE-2731
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2731
             Project: Hadoop Map/Reduce
          Issue Type: Bug
          Components: jobtracker
            Reporter: Adam Kramer


Hadoop reporting 100% complete is a lie whenever the job, task, or node is not 
FULLY complete. Reports of 100% due to rounding should get explicitly stuck at 
99.99% until the job is complete. The current system gets things stuck at 100%, 
which is simply wrong.

Even when the true % complete rounds to 100, 100% is still not appropriate to 
report in the form of a percentage due to the semantics of percentages.

This bug occurs frequently when a small number of nodes from a task with many 
nodes are running very slowly (i.e., the "one overloaded reducer" problem).

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Reply via email to