[
https://issues.apache.org/jira/browse/YARN-5123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15299008#comment-15299008
]
Subru Krishnan commented on YARN-5123:
--------------------------------------
[~lavkesh], overall +1 on the proposal as this is something we are considering
too. In fact, the first implementation of the stores in Federation (YARN-2915)
is SQL based.
A couple of questions:
* I feel it'll be more easier if we separate out leader election/fencing from
the specific StateStore choice itself so that we can utilize each framework's
strength. For e.g.: we are looking at using ZooKeeper for leader
election/fencing and a SQL based StateStore. The flip side is we have to deploy
two systems but there are other components which use ZK so we will anyway have
to deploy it. This should also simplify your implementation quite a bit. Does
this make sense?
* IIUC, can we make the SQLOperations impl DB agnostic by externalizing the
prepared statements?
> SQL based RM state store
> ------------------------
>
> Key: YARN-5123
> URL: https://issues.apache.org/jira/browse/YARN-5123
> Project: Hadoop YARN
> Issue Type: New Feature
> Affects Versions: 2.6.0
> Reporter: Lavkesh Lahngir
> Attachments: sqlstatestore.patch
>
>
> In our setup, zookeeper based RM state store didn't work. We ended up
> implementing our own SQL based state store. Here is a patch, if anybody else
> wants to use it.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
