[ 
https://issues.apache.org/jira/browse/YARN-3154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14309973#comment-14309973
 ] 

Xuan Gong commented on YARN-3154:
---------------------------------

We can add a parameter in logAggregationContext and indicate whether this app 
is LRS app. Based on this flag, the NM can decide whether it need to upload the 
partial logs for this app

> Should not upload partial logs for MR jobs or other "short-running' 
> applications 
> ---------------------------------------------------------------------------------
>
>                 Key: YARN-3154
>                 URL: https://issues.apache.org/jira/browse/YARN-3154
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: nodemanager, resourcemanager
>            Reporter: Xuan Gong
>            Assignee: Xuan Gong
>            Priority: Blocker
>
> Currently, if we are running a MR job, and we do not set the log interval 
> properly, we will have their partial logs uploaded and then removed from the 
> local filesystem which is not right.
> We only upload the partial logs for LRS applications.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to