[ https://issues.apache.org/jira/browse/YARN-7497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16418458#comment-16418458 ]
Weiwei Yang commented on YARN-7497: ----------------------------------- Hi [~yangjiandan] Thanks for the updates. Please see my comments below # YarnConfiguration.HDFS_CONFIGURATION_STORE also needs to be renamed to \{{YarnConfiguration.FS_CONFIGURATION_STORE}} # public static final String HDFS_CONFIGURATION_STORE = "hdfs"; >> lets rename this to "fs" to be more general # FSSchedulerConfigurationStore: I don't see any place to close fileSystem. We need to ensure logMutation, confirmMutation and retrieve both closes fileSystem after they have done using it. Thanks > Add HDFSSchedulerConfigurationStore for RM HA > --------------------------------------------- > > Key: YARN-7497 > URL: https://issues.apache.org/jira/browse/YARN-7497 > Project: Hadoop YARN > Issue Type: Sub-task > Components: yarn > Reporter: Jiandan Yang > Assignee: Jiandan Yang > Priority: Major > Attachments: YARN-7497.001.patch, YARN-7497.002.patch, > YARN-7497.003.patch, YARN-7497.004.patch, YARN-7497.005.patch, > YARN-7497.006.patch, YARN-7497.007.patch, YARN-7497.008.patch, > YARN-7497.009.patch > > > YARN-5947 add LeveldbConfigurationStore using Leveldb as backing store, but > it does not support Yarn RM HA. > YARN-6840 supports RM HA, but too many scheduler configurations may exceed > znode limit, for example 10 thousand queues. > HDFSSchedulerConfigurationStore store conf file in HDFS, when RM failover, > new active RM can load scheduler configuration from HDFS. -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org