[
https://issues.apache.org/jira/browse/YARN-2985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14257808#comment-14257808
]
Xu Yang commented on YARN-2985:
-------------------------------
Hi [~Naganarasimha]. Thank you for your question. I do not have a clear
statement. I mean that if YARN need a feature to delete the aggregated logs.
When I submit a patch job, if its ApplicationMaster has no
AggregatedLogDeletionService, or before the time to delete overtime logs it`s
over, its aggregated logs (HDFS) will never be cleared.
> YARN should support to delete the aggregated logs for Non-MapReduce
> applications
> --------------------------------------------------------------------------------
>
> Key: YARN-2985
> URL: https://issues.apache.org/jira/browse/YARN-2985
> Project: Hadoop YARN
> Issue Type: New Feature
> Components: log-aggregation, nodemanager
> Reporter: Xu Yang
>
> Before Hadoop 2.6, the LogAggregationService is started in NodeManager. But
> the AggregatedLogDeletionService is started in mapreduce`s JobHistoryServer.
> Therefore, the Non-MapReduce application can aggregate their logs to HDFS,
> but can not delete those logs. Need the NodeManager take over the function of
> aggregated log deletion.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)