[
https://issues.apache.org/jira/browse/YARN-4464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15061968#comment-15061968
]
KWON BYUNGCHANG commented on YARN-4464:
---------------------------------------
I have a question.
my cluster is not secure mode.
{{RMAppRoot}} has 6 files. however {{RMDTSecretManagerRoot}} has 4020 files.
{code}
magnum-mbp:~/c3$ hdfs dfs -ls /system/yarn/rmstore/FSRMStateRoot/RMAppRoot | wc
-l
6
magnum-mbp:~/c3$ hdfs dfs -ls
/system/yarn/rmstore/FSRMStateRoot/RMDTSecretManagerRoot/ | wc -l
4020
{code}
I think files count of {{RMDTSecretManagerRoot}} will influence RM recovery
process.
How do I reduce files count?
I do not configure below properties.
{code}
yarn.resourcemanager.delegation.key.update-interval
yarn.resourcemanager.delegation.token.renew-interval
yarn.resourcemanager.delegation.token.max-lifetime
{code}
> default value of yarn.resourcemanager.state-store.max-completed-applications
> should lower.
> ------------------------------------------------------------------------------------------
>
> Key: YARN-4464
> URL: https://issues.apache.org/jira/browse/YARN-4464
> Project: Hadoop YARN
> Issue Type: Wish
> Components: resourcemanager
> Reporter: KWON BYUNGCHANG
> Assignee: Daniel Templeton
> Priority: Blocker
>
> my cluster has 120 nodes.
> I configured RM Restart feature.
> {code}
> yarn.resourcemanager.recovery.enabled=true
> yarn.resourcemanager.store.class=org.apache.hadoop.yarn.server.resourcemanager.recovery.FileSystemRMStateStore
> yarn.resourcemanager.fs.state-store.uri=/system/yarn/rmstore
> {code}
> unfortunately I did not configure
> {{yarn.resourcemanager.state-store.max-completed-applications}}.
> so that property configured default value 10,000.
> I have restarted RM due to changing another configuartion.
> I expected that RM restart immediately.
> recovery process was very slow. I have waited about 20min.
> realize missing
> {{yarn.resourcemanager.state-store.max-completed-applications}}.
> its default value is very huge.
> need to change lower value or document notice on [RM Restart
> page|http://hadoop.apache.org/docs/stable/hadoop-yarn/hadoop-yarn-site/ResourceManagerRestart.html].
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
