[
https://issues.apache.org/jira/browse/YARN-7497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16418458#comment-16418458
]
Weiwei Yang commented on YARN-7497:
-----------------------------------
Hi [~yangjiandan]
Thanks for the updates. Please see my comments below
# YarnConfiguration.HDFS_CONFIGURATION_STORE also needs to be renamed to
\{{YarnConfiguration.FS_CONFIGURATION_STORE}}
# public static final String HDFS_CONFIGURATION_STORE = "hdfs"; >> lets
rename this to "fs" to be more general
# FSSchedulerConfigurationStore: I don't see any place to close fileSystem. We
need to ensure logMutation, confirmMutation and retrieve both closes fileSystem
after they have done using it.
Thanks
> Add HDFSSchedulerConfigurationStore for RM HA
> ---------------------------------------------
>
> Key: YARN-7497
> URL: https://issues.apache.org/jira/browse/YARN-7497
> Project: Hadoop YARN
> Issue Type: Sub-task
> Components: yarn
> Reporter: Jiandan Yang
> Assignee: Jiandan Yang
> Priority: Major
> Attachments: YARN-7497.001.patch, YARN-7497.002.patch,
> YARN-7497.003.patch, YARN-7497.004.patch, YARN-7497.005.patch,
> YARN-7497.006.patch, YARN-7497.007.patch, YARN-7497.008.patch,
> YARN-7497.009.patch
>
>
> YARN-5947 add LeveldbConfigurationStore using Leveldb as backing store, but
> it does not support Yarn RM HA.
> YARN-6840 supports RM HA, but too many scheduler configurations may exceed
> znode limit, for example 10 thousand queues.
> HDFSSchedulerConfigurationStore store conf file in HDFS, when RM failover,
> new active RM can load scheduler configuration from HDFS.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
