[
https://issues.apache.org/jira/browse/HDFS-16943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17698563#comment-17698563
]
ASF GitHub Bot commented on HDFS-16943:
---------------------------------------
virajjasani commented on PR #5469:
URL: https://github.com/apache/hadoop/pull/5469#issuecomment-1462583712
Using MySQL too is an external dependency, just like Zookeeper. I wonder if
we should make StateStoreDrive IA.Public for others to extend it. Similar to
MySQL, one should be able to use postgres and other databases too, but each
impl might bring too much of external dependencies in hadoop, making the
dependency management difficult over a period of time (more transitive CVE
exposures?). WDYT?
For this one though, it's still manageable as mysql dependencies are already
added (for token store impl).
cc @goiri @slfan1989
> RBF: Implement MySQL based StateStoreDriver
> -------------------------------------------
>
> Key: HDFS-16943
> URL: https://issues.apache.org/jira/browse/HDFS-16943
> Project: Hadoop HDFS
> Issue Type: Task
> Components: hdfs, rbf
> Reporter: Simbarashe Dzinamarira
> Assignee: Simbarashe Dzinamarira
> Priority: Major
> Labels: pull-request-available
>
> RBF supports two types of StateStoreDrivers
> # StateStoreFileImpl
> # StateStoreZooKeeperImpl
> I propose implementing a third driver that is backed by MySQL.
> * StateStoreZooKeeperImpl requires an additional Zookeeper cluster.
> * StateStoreFileImpl can use one of the namenodes in the HDFS cluster, but
> that namenode becomes a single point of failure, introducing coupling between
> the federated clusters.
> HADOOP-18535 implemented a MySQL token store. When tokens are stored in
> MySQL, using MySQL for the StateStore as well reduces the number of external
> dependencies for routers.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
