[
https://issues.apache.org/jira/browse/PIG-3585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13836119#comment-13836119
]
Cheolsoo Park commented on PIG-3585:
------------------------------------
Yes, it should be possible. Alternatively, I am thinking that we could attach
multiple file inputs directly to the root vertex, and each task will pull the
inputs in order. But only one of them will actually return records depending on
which split the task lands on. The Tez error message implies Tez will support
multiple inputs for the root vertex eventually.
Anyway, we can discuss further later. Thank you again for the review!
> Make union work with tez
> ------------------------
>
> Key: PIG-3585
> URL: https://issues.apache.org/jira/browse/PIG-3585
> Project: Pig
> Issue Type: Sub-task
> Components: tez
> Affects Versions: tez-branch
> Reporter: Cheolsoo Park
> Assignee: Cheolsoo Park
> Fix For: tez-branch
>
> Attachments: PIG-3585-1.patch
>
>
> Unlike MR, union needs to be implemented as multiple vertices because Tez
> doesn't allow multiple inputs in root vertex.
> I propose that we implement union by connecting load vertices to union vertex
> with broadcasting edges.
--
This message was sent by Atlassian JIRA
(v6.1#6144)