David Ross created SPARK-6482:
---------------------------------
Summary: Remove synchronization of Hive Native commands
Key: SPARK-6482
URL: https://issues.apache.org/jira/browse/SPARK-6482
Project: Spark
Issue Type: Improvement
Reporter: David Ross
As discussed in https://issues.apache.org/jira/browse/SPARK-4908, concurrent
hive native commands run into thread-safety issues with
{{org.apache.hadoop.hive.ql.Driver}}.
The quick-fix was to synchronize calls to {{runHive}}:
https://github.com/apache/spark/commit/480bd1d2edd1de06af607b0cf3ff3c0b16089add
However, if the hive native command is long-running, this can block subsequent
queries if they have native dependencies.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
