[
https://issues.apache.org/jira/browse/YARN-9080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16797068#comment-16797068
]
Prabhu Joseph commented on YARN-9080:
-------------------------------------
[~Rakesh_Shah] Thanks for reviewing. Without the fix of deleting older bucket
dirs, cleanLogs will recursively iterate all n clusterts dirs where n keeps
increasing every RM Restart. With the fix, cleanLogs has to iterate only
clusterts dirs which are not older that retention. But the fix patch v4 does
twice iteration of the clusterts dirs - have merged both cleanLogs and
cleanBuckets so that it iterates only once.
> Bucket Directories as part of ATS done accumulates
> --------------------------------------------------
>
> Key: YARN-9080
> URL: https://issues.apache.org/jira/browse/YARN-9080
> Project: Hadoop YARN
> Issue Type: Bug
> Reporter: Prabhu Joseph
> Assignee: Prabhu Joseph
> Priority: Major
> Attachments: 0001-YARN-9080.patch, 0002-YARN-9080.patch,
> 0003-YARN-9080.patch, YARN-9080-004.patch, YARN-9080-005.patch
>
>
> Have observed older bucket directories cluster_timestamp, bucket1 and bucket2
> as part of ATS done accumulates. The cleanLogs part of EntityLogCleaner
> removes only the app directories and not the bucket directories.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
