Vinod Kumar Vavilapalli commented on YARN-3154:

Does having two separate notions work?
 - Today's LogAggregationContext's include/exclude patterns for the app to 
indicate which log files need to be aggregated explicitly at app finish. This 
works for regular apps.
 - A new include/exclude pattern for app to indicate which log files need to be 
aggregated in a rolling fashion.

> Should not upload partial logs for MR jobs or other "short-running' 
> applications 
> ---------------------------------------------------------------------------------
>                 Key: YARN-3154
>                 URL: https://issues.apache.org/jira/browse/YARN-3154
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: nodemanager, resourcemanager
>            Reporter: Xuan Gong
>            Assignee: Xuan Gong
>            Priority: Blocker
> Currently, if we are running a MR job, and we do not set the log interval 
> properly, we will have their partial logs uploaded and then removed from the 
> local filesystem which is not right.
> We only upload the partial logs for LRS applications.

This message was sent by Atlassian JIRA

Reply via email to