[
https://issues.apache.org/jira/browse/TEZ-3477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15646080#comment-15646080
]
Ming Ma commented on TEZ-3477:
------------------------------
Thanks [~jeagles] for the clarification. Is the missing annotation for
"mapreduce" version of createSplitProto and createNewFormatSplitFromUserPayload
intentional? The patch adds annotation for "mapred" version of createSplitProto
and createOldFormatSplitFromUserPayload, but not for "mapreduce". Otherwise,
the patch looks good.
> MRInputHelpers generateInputSplitsToMem public API modified
> -----------------------------------------------------------
>
> Key: TEZ-3477
> URL: https://issues.apache.org/jira/browse/TEZ-3477
> Project: Apache Tez
> Issue Type: Bug
> Reporter: Jonathan Eagles
> Assignee: Jonathan Eagles
> Attachments: TEZ-3477.1.patch, TEZ-3477.2.patch
>
>
> Pig and Hive directly rely on specific APIs in MRInputHelpers. I would like
> to ensure these signature are prevented from being modified.
> - MRInputHelpers.generateInputSplitsToMem
> - MRInputHelpers.parseMRInputPayload
> - MRInputHelpers.createSplitProto
> - MRInputHelpers.createOldFormatSplitFromUserPayload
> - MRInputHelpers.configureMRInputWithLegacySplitGeneration
> A recent fixed jira TEZ-3430 modified generateInputSplitsToMem
> {code}
> java.lang.NoSuchMethodError:
> org.apache.tez.mapreduce.hadoop.MRInputHelpers.generateInputSplitsToMem(Lorg/apache/hadoop/conf/Configuration;ZI)Lorg/apache/tez/mapreduce/hadoop/InputSplitInfoMem;
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
