[
https://issues.apache.org/jira/browse/HDFS-16943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17698582#comment-17698582
]
ASF GitHub Bot commented on HDFS-16943:
---------------------------------------
simbadzina commented on PR #5469:
URL: https://github.com/apache/hadoop/pull/5469#issuecomment-1462675721
> Using MySQL too is an external dependency, just like Zookeeper. I wonder
if we should make StateStoreDrive IA.Public for others to extend it. Similar to
MySQL, one should be able to use postgres and other databases too, but each
impl might bring too much of external dependencies in hadoop, making the
dependency management difficult over a period of time (more transitive CVE
exposures?). WDYT? For this one though, it's still manageable as mysql
dependencies are already added (for token store impl).
>
> cc @goiri @slfan1989
Yes, I agree it an external dependency. The desire it to depend on just one
system MySQL for both the StateStore and DelegationTokens(HADOOP-18535).
So StateStoreDriver is already public and can be configured with
`dfs.federation.router.store.driver.class` .
I just tested moving my new class to a separate package and all the
utilities I accessed are still reachable.
> RBF: Implement MySQL based StateStoreDriver
> -------------------------------------------
>
> Key: HDFS-16943
> URL: https://issues.apache.org/jira/browse/HDFS-16943
> Project: Hadoop HDFS
> Issue Type: Task
> Components: hdfs, rbf
> Reporter: Simbarashe Dzinamarira
> Assignee: Simbarashe Dzinamarira
> Priority: Major
> Labels: pull-request-available
>
> RBF supports two types of StateStoreDrivers
> # StateStoreFileImpl
> # StateStoreZooKeeperImpl
> I propose implementing a third driver that is backed by MySQL.
> * StateStoreZooKeeperImpl requires an additional Zookeeper cluster.
> * StateStoreFileImpl can use one of the namenodes in the HDFS cluster, but
> that namenode becomes a single point of failure, introducing coupling between
> the federated clusters.
> HADOOP-18535 implemented a MySQL token store. When tokens are stored in
> MySQL, using MySQL for the StateStore as well reduces the number of external
> dependencies for routers.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
