[ 
https://issues.apache.org/jira/browse/YARN-3154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14310042#comment-14310042
 ] 

Vinod Kumar Vavilapalli commented on YARN-3154:
-----------------------------------------------

Does having two separate notions work?
 - Today's LogAggregationContext's include/exclude patterns for the app to 
indicate which log files need to be aggregated explicitly at app finish. This 
works for regular apps.
 - A new include/exclude pattern for app to indicate which log files need to be 
aggregated in a rolling fashion.

> Should not upload partial logs for MR jobs or other "short-running' 
> applications 
> ---------------------------------------------------------------------------------
>
>                 Key: YARN-3154
>                 URL: https://issues.apache.org/jira/browse/YARN-3154
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: nodemanager, resourcemanager
>            Reporter: Xuan Gong
>            Assignee: Xuan Gong
>            Priority: Blocker
>
> Currently, if we are running a MR job, and we do not set the log interval 
> properly, we will have their partial logs uploaded and then removed from the 
> local filesystem which is not right.
> We only upload the partial logs for LRS applications.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to