[
https://issues.apache.org/jira/browse/YARN-8637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16615094#comment-16615094
]
Botong Huang commented on YARN-8637:
------------------------------------
Thanks [~subru] for the comment! I looked into other _FederationStateStore_
implementations. I realize that since application entry timestamp is not in the
_FederationStateStore_ api, all other implementations doesn't have it at all.
Only the SQLServer table script added a timestamp field to the app table.
Also having [~bibinchundatt]'s comment in YARN-7599 in mind, I am thinking
about not introducing the timestamp into the application entry in StateStore
API, since it will introduce more source of truth confusion about the app start
time as opposed to timeline server. Instead, the application cleanup in
YARN-7599 can simply depend on whether Router/YarnRM still remember the app in
their memory. So essentially we can reply on YarnRM's cleanup config to clean
up Application table in StateStore.
What do you guys think?
> [GPG] Add FederationStateStore getAppInfo API for GlobalPolicyGenerator
> -----------------------------------------------------------------------
>
> Key: YARN-8637
> URL: https://issues.apache.org/jira/browse/YARN-8637
> Project: Hadoop YARN
> Issue Type: Sub-task
> Reporter: Botong Huang
> Assignee: Botong Huang
> Priority: Major
> Attachments: YARN-8637-YARN-7402.v1.patch
>
>
> The core api for FederationStateStore is provided in _FederationStateStore_.
> In this patch, we are added a _FederationGPGStateStore_ api just for GPG.
> Specifically, we are adding the API to get full application info from
> statestore with the starting timestamp of the app entry, so that the
> _ApplicationCleaner_ (YARN-7599) in GPG can delete and cleanup old entries in
> the table.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
