Siddharth Seth created TEZ-1948:
-----------------------------------
Summary: mergedMapOutput counters can be incorrect in case of on
disk merges
Key: TEZ-1948
URL: https://issues.apache.org/jira/browse/TEZ-1948
Project: Apache Tez
Issue Type: Bug
Reporter: Siddharth Seth
In TezMerger
{code}
Constants.MERGED_OUTPUT_PREFIX) ?
null : mergedMapOutputsCounter)));
{code}
The MergeManager now writes out merge files with an id at the end, which can
cause this counter to be incorrect.
There's another jira to move the merge file name generation into TezOutputFiles.
This may be as simple as moving the id appended to the merged files before the
suffix.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
