[
https://issues.apache.org/jira/browse/YARN-4325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15226861#comment-15226861
]
Junping Du commented on YARN-4325:
----------------------------------
bq. If set yarn.log-aggregation-enable = false, does NM recovery work well?
It supposed to be. YARN-2079 address non-aggregation log cases.
bq. Junping Du, any update on your debugging?
No. Unfortunately, I didn't track the original cluster again. Let's move it out
of 2.7.3 and 2.6.5 and fix it next time we see this again...
> purge app state from NM state-store should be independent of log aggregation
> ----------------------------------------------------------------------------
>
> Key: YARN-4325
> URL: https://issues.apache.org/jira/browse/YARN-4325
> Project: Hadoop YARN
> Issue Type: Bug
> Affects Versions: 2.6.0
> Reporter: Junping Du
> Assignee: Junping Du
> Priority: Critical
>
> From a long running cluster, we found tens of thousands of stale apps still
> be recovered in NM restart recovery. The reason is some wrong configuration
> setting to log aggregation so the end of log aggregation events are not
> received so stale apps are not purged properly. We should make sure the
> removal of app state to be independent of log aggregation life cycle.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
