[ 
https://issues.apache.org/jira/browse/SPARK-2814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Cheng Lian updated SPARK-2814:
------------------------------

    Description: 
After [PR #1686|https://github.com/apache/spark/pull/1686], 
{{HiveThriftServer2}} throws exception when executing native commands.

The reason is that initialization of {{HiveContext.sessionState.out}} and 
{{HiveContext.sessionState.err}} were made lazy, while {{HiveThriftServer2}} 
uses an overriden version of {{HiveContext}} that doesn't know how to 
initialize these two streams. When {{HiveContext.runHive}} tries to write to 
{{HiveContext.sessionState.out}}, an NPE is throw.

Reproduction steps:

# Start HiveThriftServer2
# Connect to it via beeline
# Execute `set;`

Exception thrown:
{code}
======================
HIVE FAILURE OUTPUT
======================


======================
END HIVE FAILURE OUTPUT
======================

14/08/03 21:30:55 ERROR SparkSQLOperationManager: Error executing query:
java.lang.NullPointerException
        at org.apache.spark.sql.hive.HiveContext.runHive(HiveContext.scala:210)
        at 
org.apache.spark.sql.hive.HiveContext.runSqlHive(HiveContext.scala:173)
        at org.apache.spark.sql.hive.HiveContext.set(HiveContext.scala:144)
        at 
org.apache.spark.sql.execution.SetCommand.sideEffectResult$lzycompute(commands.scala:59)
        at 
org.apache.spark.sql.execution.SetCommand.sideEffectResult(commands.scala:50)
        ...
{code}

  was:
After [PR #1686|https://github.com/apache/spark/pull/1686], 
{{HiveThriftServer2}} throws exception when executing native commands.

The reason is that initialization of {{HiveContext.sessionState.out}} and 
{{HiveContext.sessionState.err}} were made lazy, while {{HiveThriftServer2}} 
uses an overriden version of {{HiveContext}} that doesn't know how to 
initialize these two streams.

Reproduction steps:

# Start HiveThriftServer2
# Connect to it via beeline
# Execute `set;`

Exception thrown:
{code}
======================
HIVE FAILURE OUTPUT
======================


======================
END HIVE FAILURE OUTPUT
======================

14/08/03 21:30:55 ERROR SparkSQLOperationManager: Error executing query:
java.lang.NullPointerException
        at org.apache.spark.sql.hive.HiveContext.runHive(HiveContext.scala:210)
        at 
org.apache.spark.sql.hive.HiveContext.runSqlHive(HiveContext.scala:173)
        at org.apache.spark.sql.hive.HiveContext.set(HiveContext.scala:144)
        at 
org.apache.spark.sql.execution.SetCommand.sideEffectResult$lzycompute(commands.scala:59)
        at 
org.apache.spark.sql.execution.SetCommand.sideEffectResult(commands.scala:50)
        ...
{code}


> HiveThriftServer throws NPE when executing native commands
> ----------------------------------------------------------
>
>                 Key: SPARK-2814
>                 URL: https://issues.apache.org/jira/browse/SPARK-2814
>             Project: Spark
>          Issue Type: Bug
>          Components: SQL
>    Affects Versions: 1.1.0
>            Reporter: Cheng Lian
>
> After [PR #1686|https://github.com/apache/spark/pull/1686], 
> {{HiveThriftServer2}} throws exception when executing native commands.
> The reason is that initialization of {{HiveContext.sessionState.out}} and 
> {{HiveContext.sessionState.err}} were made lazy, while {{HiveThriftServer2}} 
> uses an overriden version of {{HiveContext}} that doesn't know how to 
> initialize these two streams. When {{HiveContext.runHive}} tries to write to 
> {{HiveContext.sessionState.out}}, an NPE is throw.
> Reproduction steps:
> # Start HiveThriftServer2
> # Connect to it via beeline
> # Execute `set;`
> Exception thrown:
> {code}
> ======================
> HIVE FAILURE OUTPUT
> ======================
> ======================
> END HIVE FAILURE OUTPUT
> ======================
> 14/08/03 21:30:55 ERROR SparkSQLOperationManager: Error executing query:
> java.lang.NullPointerException
>         at 
> org.apache.spark.sql.hive.HiveContext.runHive(HiveContext.scala:210)
>         at 
> org.apache.spark.sql.hive.HiveContext.runSqlHive(HiveContext.scala:173)
>         at org.apache.spark.sql.hive.HiveContext.set(HiveContext.scala:144)
>         at 
> org.apache.spark.sql.execution.SetCommand.sideEffectResult$lzycompute(commands.scala:59)
>         at 
> org.apache.spark.sql.execution.SetCommand.sideEffectResult(commands.scala:50)
>         ...
> {code}



--
This message was sent by Atlassian JIRA
(v6.2#6252)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to