[ 
https://issues.apache.org/jira/browse/YARN-2985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14257808#comment-14257808
 ] 

Xu Yang commented on YARN-2985:
-------------------------------

Hi [~Naganarasimha]. Thank you for your question. I do not have a clear 
statement. I mean that if YARN need a feature to delete the aggregated logs. 
When I submit a patch job, if its ApplicationMaster has no 
AggregatedLogDeletionService, or before the time to delete overtime logs it`s 
over, its aggregated logs (HDFS) will never be cleared.

> YARN should support to delete the aggregated logs for Non-MapReduce 
> applications
> --------------------------------------------------------------------------------
>
>                 Key: YARN-2985
>                 URL: https://issues.apache.org/jira/browse/YARN-2985
>             Project: Hadoop YARN
>          Issue Type: New Feature
>          Components: log-aggregation, nodemanager
>            Reporter: Xu Yang
>
> Before Hadoop 2.6, the LogAggregationService is started in NodeManager. But 
> the AggregatedLogDeletionService is started in mapreduce`s JobHistoryServer. 
> Therefore, the Non-MapReduce application can aggregate their logs to HDFS, 
> but can not delete those logs. Need the NodeManager take over the function of 
> aggregated log deletion.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to