[
https://issues.apache.org/jira/browse/HIVE-4226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13612900#comment-13612900
]
Sivaramakrishnan Narayanan commented on HIVE-4226:
--------------------------------------------------
[~shreepadma] QHS was built from scratch. I will be writing a blog about it
this week and send it around. Basically, Qubole offers hive as a service to
multiple accounts. Each account has a separate metastore (and separate hadoop
cluster). Each of these accounts may submit queries concurrently. Hence, we
required a multi-tenant, multi-threaded hive server.
However, the API itself is pretty modest compared to existing HiveServer. The
API simply asks QHS to execute a set of statements. This is because Qubole
maintains a notion of session outside of HiveServer and passes state modifying
statements (e.g. set statements) as part of an 'execute' call to QHS.
Getting QHS to run smoothly required a few other changes which are not directly
related to this JIRA, but might well be applicable to any incarnation of
HiveServer. I'll write these up as well and, hopefully, someone will find them
useful.
> Cleanup non-threadsafe code in Hive
> -----------------------------------
>
> Key: HIVE-4226
> URL: https://issues.apache.org/jira/browse/HIVE-4226
> Project: Hive
> Issue Type: Improvement
> Reporter: Sivaramakrishnan Narayanan
>
> There is some code in Hive that is not threadsafe. These usually bubble up as
> problems in Hive Server. This JIRA tracks fixing (hopefully, all) of these
> issues.
> Some context: we've implemented a multi-tenant (multiple dbs), multi-threaded
> hive server at Qubole (QHS) which is running in production for a couple of
> months now. As part of this effort, we've fixed a number of instances of
> non-threadsafe code. I'm looking to contribute this back to the community.
> Note that there is no new functionality here - just some better hygiene. If
> there are any stress tests that have revealed hive server bugs in the past,
> it will be great if they can be added to the jira.
> Also, this is my first attempt at contributing to Apache, so please forgive
> any mistakes.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
