[
https://issues.apache.org/jira/browse/HIVE-13308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15281147#comment-15281147
]
Rui Li commented on HIVE-13308:
-------------------------------
Thanks very much [~vanzin] for your inputs. Like [~wenli] said,
SparkClientFactory is stopped only when hiveserver2 shuts down, so we don't
have to worry about {{server}} is null while we creating the client.
What I'm not sure is that {{server}} is used to generate the secret and
register the RemoteDriver, during creating the SparkClientImpl. Without
synchronization, we need the {{server}} to be thread safe.
> HiveOnSpark sumbit query very slow when hundred of beeline exectue at same
> time
> -------------------------------------------------------------------------------
>
> Key: HIVE-13308
> URL: https://issues.apache.org/jira/browse/HIVE-13308
> Project: Hive
> Issue Type: Bug
> Components: Spark
> Affects Versions: 1.2.1
> Reporter: wangwenli
> Original Estimate: 1h
> Remaining Estimate: 1h
>
> backgroud: hive on spark , yarn cluster mode
> details:
> when using hundred of beeline submit query at the same time, we found that
> yarn get application very slow, and hiveserver is blocked at
> SparkClientFactory.createClient method
> after analysis, we think the synchronize on SparkClientFactory.createClient ,
> can be removed
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
