[ 
https://issues.apache.org/jira/browse/PIG-3591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Mark Wagner updated PIG-3591:
-----------------------------

    Attachment: PIG-3591.1.patch

Separate "packaging" logic from "shuffle handling" logic. This moves the 
packaging logic to a new class "Packager", which is extended by 
CombinePackager, LitePackager, MultiQueryPackager, and JoinPackager.

This is not finished. Known problems are illustrate and streaming the last 
input are not implemented.

> Refactor POPackage to separate MR specific code from packaging
> --------------------------------------------------------------
>
>                 Key: PIG-3591
>                 URL: https://issues.apache.org/jira/browse/PIG-3591
>             Project: Pig
>          Issue Type: Bug
>            Reporter: Mark Wagner
>            Assignee: Mark Wagner
>         Attachments: PIG-3591.1.patch
>
>
> POPackage is currently closely associated with the MR shuffle semantics. This 
> makes it difficult to adapt the variety of subclasses of POPackage to other 
> execution engines without duplicating code.



--
This message was sent by Atlassian JIRA
(v6.1#6144)

Reply via email to