[
https://issues.apache.org/jira/browse/PIG-94?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arun C Murthy updated PIG-94:
-----------------------------
Attachment: PIG-94_2_0_20080317.patch
Here is a patch which implements more of the Streaming spec... specifically it
enhances the DEFINE to allow users to specify ship/cache/input/output specs and
also saves stderr of the tasks to HDFS.
Note: This patch needs PIG-154 in-order to get parsing the
ship/cache/input/output specs right (it currently just uses square brackets
instead of parenthesis).
E.g.s
{noformat}
define X `./myscript.py foo bar` ship['./myscript.py'] input['foo' using
PigStorage(',')] output['bar' using PigStorage(',')];
IP = load '/pig/in' using PigStorage(',');
FILTERED_DATA = filter IP by $1 > '3';
OP = stream FILTERED_DATA through X;
dump OP;
{noformat}
As such, this is just for an early review and not ready for committing yet.
> Pig Streaming functional spec proposal
> --------------------------------------
>
> Key: PIG-94
> URL: https://issues.apache.org/jira/browse/PIG-94
> Project: Pig
> Issue Type: New Feature
> Reporter: Olga Natkovich
> Assignee: Arun C Murthy
> Attachments: patch.txt, PIG-94_1_1_20080304.patch,
> PIG-94_1_20080303.patch, PIG-94_2_0_20080317.patch, PigStreamingTestPlan.htm
>
>
> This issue is for discussion about Pig streaming functional spec.
> http://wiki.apache.org/pig/PigStreamingFunctionalSpec
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
