KWON BYUNGCHANG commented on YARN-4464:

I have a question.
my cluster is not secure mode.
{{RMAppRoot}} has 6 files.  however {{RMDTSecretManagerRoot}} has 4020 files.

magnum-mbp:~/c3$ hdfs dfs -ls /system/yarn/rmstore/FSRMStateRoot/RMAppRoot | wc 
magnum-mbp:~/c3$ hdfs dfs -ls 
/system/yarn/rmstore/FSRMStateRoot/RMDTSecretManagerRoot/ | wc -l

I think files count of {{RMDTSecretManagerRoot}} will influence RM recovery 
How do I reduce files count?

I do not configure below properties.

> default value of yarn.resourcemanager.state-store.max-completed-applications 
> should lower.
> ------------------------------------------------------------------------------------------
>                 Key: YARN-4464
>                 URL: https://issues.apache.org/jira/browse/YARN-4464
>             Project: Hadoop YARN
>          Issue Type: Wish
>          Components: resourcemanager
>            Reporter: KWON BYUNGCHANG
>            Assignee: Daniel Templeton
>            Priority: Blocker
> my cluster has 120 nodes.
> I configured RM Restart feature.
> {code}
> yarn.resourcemanager.recovery.enabled=true
> yarn.resourcemanager.store.class=org.apache.hadoop.yarn.server.resourcemanager.recovery.FileSystemRMStateStore
> yarn.resourcemanager.fs.state-store.uri=/system/yarn/rmstore
> {code}
> unfortunately I did not configure 
> {{yarn.resourcemanager.state-store.max-completed-applications}}.
> so that property configured default value 10,000.
> I have restarted RM due to changing another configuartion.
> I expected that RM restart immediately.
> recovery process was very slow.  I have waited about 20min.  
> realize missing 
> {{yarn.resourcemanager.state-store.max-completed-applications}}.
> its default value is very huge.  
> need to change lower value or document notice on [RM Restart 
> page|http://hadoop.apache.org/docs/stable/hadoop-yarn/hadoop-yarn-site/ResourceManagerRestart.html].

This message was sent by Atlassian JIRA

Reply via email to