[
https://issues.apache.org/jira/browse/HIVE-869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12763895#action_12763895
]
Venky Iyer commented on HIVE-869:
---------------------------------
Reading the patch very cursorily made it seem as if we weren't checking the
exit status of the script. Checking that the exit code was 0 is absolutely
essential, or we'll mask real errors.
If we're actually checking that the script exists with success, then it seems
like the option is misnamed- should be more like
hive.script.allow.partial.consumption
or something like that.
> Allow ScriptOperator to consume not all input data
> --------------------------------------------------
>
> Key: HIVE-869
> URL: https://issues.apache.org/jira/browse/HIVE-869
> Project: Hadoop Hive
> Issue Type: New Feature
> Affects Versions: 0.5.0
> Reporter: Zheng Shao
> Assignee: Paul Yang
> Fix For: 0.5.0
>
> Attachments: HIVE-869.1.patch
>
>
> The ScriptOperator (SELECT TRANSFORM(a, b, c) USING 'myscript' AS (d, e, f)
> ...) has a problem:
> If the user script exits without consuming all data from standard input, then
> we will report an error even if the exit code from the user script is 0.
> We want to have an option, when enabled, ScriptOperator will return
> successfully in that case.
> If the option is not enabled, then we should stick to the current behavior.
> The option can be called: "hive.script.ignore.broken.pipe.exception".
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
