Tao Wang created SPARK-13935:
--------------------------------
Summary: Other clients' connection hang up when someone do huge
load
Key: SPARK-13935
URL: https://issues.apache.org/jira/browse/SPARK-13935
Project: Spark
Issue Type: Bug
Components: SQL
Affects Versions: 1.5.2, 1.5.0
Reporter: Tao Wang
Priority: Critical
We run a sql like "insert overwrite table store_returns partition
(sr_returned_date) select xxxxxx" using beeline then it will block other
beeline connection while invoke the Hive method via
"ClientWrapper.loadDynamicPartitions".
The reason is that "withHiveState" will lock "clientLoader". Sadly when a new
client comes, it will invoke "setConf" methods which is also sychronized with
"clientLoader".
So the problem is that if the first sql took very long time to run, then all
other client could not connect to thrift server successfully.
We tested on release 1.5.1. not sure if latest release has same issue.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
