[
https://issues.apache.org/jira/browse/PIG-4061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14095116#comment-14095116
]
Cheolsoo Park commented on PIG-4061:
------------------------------------
[~daijy], you're right. It works now. I don't know since when, it has been
fixed. :-)
We should remove the following comments in TezPlanContainer.java then-
{code}
// Streaming UDF's are not working under Hadoop 2 (PIG-3478), so don't
bother adding
// resources for them yet.
// if ("StreamingUDF".equals(clazz.getSimpleName())) {
// for (String fileName : StreamingUDF.getResourcesForJar()) {
// jarLists.add(new File(fileName).toURI().toURL());
// }
// }
{code}
As for your patch, you have typos in your code-
{code}
if (hadoopLogDir == null) {
+ System.getProperty("hadoop.log.dir"); //--> hadoopLogDir =
System.getProperty("hadoop.log.dir");
+ }
{code}
Btw, the code checks for "hadoop.log.dir" not only in system properties but
also in configuration. Should we do the same for "yarn.app.container.log.dir"?
> Make Streaming UDF work in Tez
> ------------------------------
>
> Key: PIG-4061
> URL: https://issues.apache.org/jira/browse/PIG-4061
> Project: Pig
> Issue Type: Sub-task
> Components: tez
> Reporter: Cheolsoo Park
> Assignee: Daniel Dai
> Fix For: 0.14.0
>
> Attachments: PIG-4061-1.patch
>
>
> PIG-3478 fixed Streaming UDF in MR2. We should get it working in Tez.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
