Wrong map-output estimates by ResourceEstimator because of overflow errors in
'long' calculations
-------------------------------------------------------------------------------------------------
Key: MAPREDUCE-1719
URL: https://issues.apache.org/jira/browse/MAPREDUCE-1719
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: jobtracker
Reporter: Vinod K V
On a cluster with disks nearly full, while running a simple sort job on a
10TBdata with ~100 maps, ResourceEstimator is not getting triggered even after
10%maps are completed. Instead, maps keep on getting scheduled till the disks
became full and then eventually when the disk size becomes zero, the
ResourceEstimator finally comes back alive saying it can find only zero bytes
instead of the estimated '9642' bytes. The estimate should have be close to
10GB.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
