[ 
https://issues.apache.org/jira/browse/SPARK-6507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Cheng Lian updated SPARK-6507:
------------------------------
    Shepherd: Cheng Lian

> Create separate Hive Driver instance for each SQL query in HiveThriftServer2
> ----------------------------------------------------------------------------
>
>                 Key: SPARK-6507
>                 URL: https://issues.apache.org/jira/browse/SPARK-6507
>             Project: Spark
>          Issue Type: Bug
>          Components: SQL
>    Affects Versions: 1.0.2, 1.1.1, 1.2.1, 1.3.0
>            Reporter: Cheng Lian
>
> In the current implementation of HiveThriftServer2, Hive {{Driver}} instances 
> are cached and reused among queries. However, {{Driver}} is not thread-safe, 
> and may cause racing conditions. In SPARK-4908, we synchronized 
> {{HiveContext.runHive}} to avoid this issue, but this affects concurrency 
> negatively, because no two native commands can be executed concurrently. This 
> is pretty bad for heavy commands like ANALYZE.
> Please refer [this 
> comment|https://issues.apache.org/jira/browse/SPARK-4908?focusedCommentId=14264469&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-14264469]
>  in SPARK-4908 for details.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to