Sandy Ryza created MAPREDUCE-5008: ------------------------------------- Summary: Merger progress miscounts with respect to EOF_MARKER Key: MAPREDUCE-5008 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5008 Project: Hadoop Map/Reduce Issue Type: Bug Affects Versions: 2.0.3-alpha Reporter: Sandy Ryza
After MAPREDUCE-2264, a segment's raw data length is calculated without the EOF_MARKER bytes. However, when the merge is counting how many bytes it processed, it includes the marker. This can cause the merge progress to go above 100%. Whether these EOF_MARKER bytes should count should be consistent between the two. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira