[
https://issues.apache.org/jira/browse/PIG-94?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12580764#action_12580764
]
Pi Song commented on PIG-94:
----------------------------
OK I'm not defining any new terminology. There are 3 cases:-
(1) 1 input record becomes 1 output record (non-blocking)
(2) A subset of input records become output records (blocking)
(3) A subset of input records become output records via input file(blocking)
For (1) you can do what I suggested.
For (2),(3) seems what you can do is monitoring if the process still alive (But
doesn't help if the process gets stuck in itself)
Still no good solution + we can improve it incrementally.
Let's keep this as a back burner work then.
Your patch looks good.
> Pig Streaming functional spec proposal
> --------------------------------------
>
> Key: PIG-94
> URL: https://issues.apache.org/jira/browse/PIG-94
> Project: Pig
> Issue Type: New Feature
> Reporter: Olga Natkovich
> Assignee: Arun C Murthy
> Attachments: patch.txt, PIG-94_1_1_20080304.patch,
> PIG-94_1_20080303.patch, PIG-94_2_0_20080317.patch, PigStreamingTestPlan.htm
>
>
> This issue is for discussion about Pig streaming functional spec.
> http://wiki.apache.org/pig/PigStreamingFunctionalSpec
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
