[
https://issues.apache.org/jira/browse/HIVE-869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zheng Shao updated HIVE-869:
----------------------------
Description:
The ScriptOperator (SELECT TRANSFORM(a, b, c) USING 'myscript' AS (d, e, f)
...) has a problem:
If the user script exits without consuming all data from standard input, then
we will report an error even if the exit code from the user script is 0.
We want to have an option, when enabled, ScriptOperator will return
successfully in that case.
If the option is not enabled, then we should stick to the current behavior.
The option can be called: "hive.script.allow.partial.consumption".
was:
The ScriptOperator (SELECT TRANSFORM(a, b, c) USING 'myscript' AS (d, e, f)
...) has a problem:
If the user script exits without consuming all data from standard input, then
we will report an error even if the exit code from the user script is 0.
We want to have an option, when enabled, ScriptOperator will return
successfully in that case.
If the option is not enabled, then we should stick to the current behavior.
The option can be called: "hive.script.ignore.broken.pipe.exception".
> Allow ScriptOperator to consume not all input data
> --------------------------------------------------
>
> Key: HIVE-869
> URL: https://issues.apache.org/jira/browse/HIVE-869
> Project: Hadoop Hive
> Issue Type: New Feature
> Affects Versions: 0.5.0
> Reporter: Zheng Shao
> Assignee: Paul Yang
> Fix For: 0.5.0
>
> Attachments: HIVE-869.1.patch, HIVE-869.2.patch, HIVE-869.3.patch
>
>
> The ScriptOperator (SELECT TRANSFORM(a, b, c) USING 'myscript' AS (d, e, f)
> ...) has a problem:
> If the user script exits without consuming all data from standard input, then
> we will report an error even if the exit code from the user script is 0.
> We want to have an option, when enabled, ScriptOperator will return
> successfully in that case.
> If the option is not enabled, then we should stick to the current behavior.
> The option can be called: "hive.script.allow.partial.consumption".
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
