[
https://issues.apache.org/jira/browse/TEZ-3477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15613988#comment-15613988
]
Ming Ma commented on TEZ-3477:
------------------------------
[~jeagles] sorry about that.
* The patch added protected createMRInputPayloadWithGrouping and
createMRInputPayload which seem unnecessary.
* Do you need to add the annotation to the mapreduce version of
createSplitProto? Same for createNewFormatSplitFromUserPayload.
> MRInputHelpers generateInputSplitsToMem public API modified
> -----------------------------------------------------------
>
> Key: TEZ-3477
> URL: https://issues.apache.org/jira/browse/TEZ-3477
> Project: Apache Tez
> Issue Type: Bug
> Reporter: Jonathan Eagles
> Assignee: Jonathan Eagles
> Attachments: TEZ-3477.1.patch, TEZ-3477.2.patch
>
>
> Pig and Hive directly rely on specific APIs in MRInputHelpers. I would like
> to ensure these signature are prevented from being modified.
> - MRInputHelpers.generateInputSplitsToMem
> - MRInputHelpers.parseMRInputPayload
> - MRInputHelpers.createSplitProto
> - MRInputHelpers.createOldFormatSplitFromUserPayload
> - MRInputHelpers.configureMRInputWithLegacySplitGeneration
> A recent fixed jira TEZ-3430 modified generateInputSplitsToMem
> {code}
> java.lang.NoSuchMethodError:
> org.apache.tez.mapreduce.hadoop.MRInputHelpers.generateInputSplitsToMem(Lorg/apache/hadoop/conf/Configuration;ZI)Lorg/apache/tez/mapreduce/hadoop/InputSplitInfoMem;
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
