Sometimes gridmix emulates data larger much larger then acutal counter for map
only jobs
----------------------------------------------------------------------------------------
Key: MAPREDUCE-4100
URL: https://issues.apache.org/jira/browse/MAPREDUCE-4100
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: contrib/gridmix
Affects Versions: 1.1.0
Reporter: Karam Singh
Priority: Minor
While running 1400+ jobs trace I encountered this issue.
For map-only jobs, observed that some Maps generating data of around 9 GB (From
HDFS_BYTES_WRITTEN) whereas actual value is around 5GB in trace.
This can sometimes also cause jobs to fail intermittently.
Other GridMix version coming be Hadoop-1.1.X and above might also effected
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
