[
https://issues.apache.org/jira/browse/PIG-4061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cheolsoo Park updated PIG-4061:
-------------------------------
Attachment: PIG-4061-3.patch
[~daijy], yes if I remove those lines, it works for me. In fact, I think those
*.py files don't need to be added to local resources since they're already
packaged in the pig.jar-
{code}
cheolsoop@lgml-cheolsoop:~/workspace/pig-svn$ jar -tvf
pig-0.14.0-SNAPSHOT-core-h2.jar | grep python
13335 Sat Aug 16 15:09:08 PDT 2014 python/streaming/controller.py
3042 Sat Aug 16 15:09:08 PDT 2014 python/streaming/pig_util.py
{code}
I see that MR doesn't add these files to distributed cache either.
In a new patch, I made the following changes-
# Removed those lines in TezPlanContainer.java.
# Removed getResourcesForJar() in StreamingUDF.java.
# Changed TestStreamingUDF.java to make it run in both MR and Tez.
> Make Streaming UDF work in Tez
> ------------------------------
>
> Key: PIG-4061
> URL: https://issues.apache.org/jira/browse/PIG-4061
> Project: Pig
> Issue Type: Sub-task
> Components: tez
> Reporter: Cheolsoo Park
> Assignee: Daniel Dai
> Fix For: 0.14.0
>
> Attachments: PIG-4061-1.patch, PIG-4061-2.patch, PIG-4061-3.patch
>
>
> PIG-3478 fixed Streaming UDF in MR2. We should get it working in Tez.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
