[
https://issues.apache.org/jira/browse/PIG-2973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cheolsoo Park updated PIG-2973:
-------------------------------
Status: Open (was: Patch Available)
Now I have a better explanation.
If input to the streaming binary is from a file, a new thread
(ProcessInputThread) is spawned, and exec() is called in that child thread. The
problem is that the UDFContext of the parent thread is not copied to the child
thread, so jobConf is null in that child thread.
I can verify this by comparing the following two test cases:
# input from a file.
# input from stdin.
I only see the failure in case 1.
I am going to update my patch as follows:
- Copy the UDFContext to the ProcessInputThread when input type is asynchronous
(i.e. input is from a file).
- Add a test case to verify environment variables are set correctly even when
input type is asynchronous.
Thanks!
> TestStreaming test times out
> ----------------------------
>
> Key: PIG-2973
> URL: https://issues.apache.org/jira/browse/PIG-2973
> Project: Pig
> Issue Type: Sub-task
> Affects Versions: 0.11
> Reporter: Rohini Palaniswamy
> Assignee: Cheolsoo Park
> Fix For: 0.11
>
> Attachments: PIG-2973.patch, test.tar.gz
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
