[
https://issues.apache.org/jira/browse/YARN-11183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17554030#comment-17554030
]
zhengchenyu edited comment on YARN-11183 at 6/17/22 9:18 AM:
-------------------------------------------------------------
The key is when remove ApplicationHomeSubCluster. What's the end of
ApplicationHomeSubCluster's lifecycle?
We know when called getApplicationReport, we must know
ApplicationHomeSubCluster. It may be the last possible to get this
application's home subcluster. So I think we should remove
ApplicationHomeSubCluster when the application is removed from
resourcemanager's memory.
Here I add AsyncDispatcher for handle federation state store. Two key point:
(1) When application is removed from RM, will delete ApplicationHomeSubCluster
from federation state store.
(2) When ResourceManager start, will check all application whether is removed
from resourcemanager memory.
was (Author: zhengchenyu):
In our first version, I remove ApplicationHomeSubCluster in federation state
store when app is remove from rm's memory. And execute delete operation in a
individual asyncdispatcher.
The patch has worked, then will be verified for serval days in our cluster.
Then I will submit PR.
> Federation: Remove outdated ApplicationHomeSubCluster in federation state
> store.
> --------------------------------------------------------------------------------
>
> Key: YARN-11183
> URL: https://issues.apache.org/jira/browse/YARN-11183
> Project: Hadoop YARN
> Issue Type: Improvement
> Components: federation, yarn
> Reporter: zhengchenyu
> Assignee: zhengchenyu
> Priority: Major
>
> Nowadays, ApplicationHomeSubCluster in federation state store can't be
> removed automatically.
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]