[
https://issues.apache.org/jira/browse/TEZ-3477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15633077#comment-15633077
]
Jonathan Eagles commented on TEZ-3477:
--------------------------------------
[~mingma], I have added back createMRInputPayloadWithGrouping and
createMRInputPayload api since a user owned subclass will have issues. Both
createSplitProto and createNewFormatSplitFromUserPayload are apis used in hive
and one goal of this ticket is to document that usage.
> MRInputHelpers generateInputSplitsToMem public API modified
> -----------------------------------------------------------
>
> Key: TEZ-3477
> URL: https://issues.apache.org/jira/browse/TEZ-3477
> Project: Apache Tez
> Issue Type: Bug
> Reporter: Jonathan Eagles
> Assignee: Jonathan Eagles
> Attachments: TEZ-3477.1.patch, TEZ-3477.2.patch
>
>
> Pig and Hive directly rely on specific APIs in MRInputHelpers. I would like
> to ensure these signature are prevented from being modified.
> - MRInputHelpers.generateInputSplitsToMem
> - MRInputHelpers.parseMRInputPayload
> - MRInputHelpers.createSplitProto
> - MRInputHelpers.createOldFormatSplitFromUserPayload
> - MRInputHelpers.configureMRInputWithLegacySplitGeneration
> A recent fixed jira TEZ-3430 modified generateInputSplitsToMem
> {code}
> java.lang.NoSuchMethodError:
> org.apache.tez.mapreduce.hadoop.MRInputHelpers.generateInputSplitsToMem(Lorg/apache/hadoop/conf/Configuration;ZI)Lorg/apache/tez/mapreduce/hadoop/InputSplitInfoMem;
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
