[
https://issues.apache.org/jira/browse/PIG-3521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mark Wagner updated PIG-3521:
-----------------------------
Attachment: PIG-3521.1.patch
RB Request: https://reviews.apache.org/r/14601/
This patch adds the PigProcessor and related changes. The current patch
supports MR* jobs.
* Updates the Tez dependency to match Tez's trunk
* Add PigProcessor which roughly follows the existing Mappers and Reducers in
Pig.
* The handling of input has been factored out of the PigProcessor into a new
interface: InputHandler. Two implementations of InputHandler have been added:
FileInputHandler and ShuffledInputHandler.
* Makes changes to TezDagBuilder to serialize and ship the necessary
information from the frontend. These changes are mostly inspired by/stolen from
the JobControlCompiler.
* Adds a TezPOPackageAnnotator which is analogous to the POPackageAnnotator,
but for Tez.
* Fixes a problem with edge creation in the TezDagBuilder.
> Initial Implementation of PigProcessor
> --------------------------------------
>
> Key: PIG-3521
> URL: https://issues.apache.org/jira/browse/PIG-3521
> Project: Pig
> Issue Type: Sub-task
> Reporter: Mark Wagner
> Assignee: Mark Wagner
> Attachments: PIG-3521.1.patch
>
>
> The PigProcessor is responsible for the backend execution of execution plans.
--
This message was sent by Atlassian JIRA
(v6.1#6144)
