[ 
https://issues.apache.org/jira/browse/YARN-5112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15291026#comment-15291026
 ] 

Junping Du commented on YARN-5112:
----------------------------------

Thanks [~jianhe] for reporting the issue and put a patch to fix it. I do see 
the similar log before and huge number of warning messages are really annoying.
+1 on refactor some log aggregation roll monitoring configuration logic from 
AppLogAggregatorImpl to LogAggregationService. It should belongs share to all 
AppAggregators rather than a particular AppAggregator. That should get rid of 
annoying message like: "rollingMonitorInterval is set as -1".
However, for another annoying messages on permission issue - "Remote Root Log 
Dir [/app-logs] already exist, but with incorrect permissions.". It will still 
exist after the patch as verifyAndCreateRemoteLogDir() get called every time 
when we init an app. We should figure some way to get rid of it and warn (or 
even error) only one time for permission issue on remoteRootLogDir.

> Excessive log warnings on NM recovery
> -------------------------------------
>
>                 Key: YARN-5112
>                 URL: https://issues.apache.org/jira/browse/YARN-5112
>             Project: Hadoop YARN
>          Issue Type: Bug
>            Reporter: Jian He
>            Assignee: Jian He
>         Attachments: YARN-5112.patch
>
>
> When there are a lot of apps to recover in NM store, NM prints these two 
> lines for each app, which gets annoying.
> {code}
> 2015-10-13 01:58:40,277 WARN  logaggregation.LogAggregationService 
> (LogAggregationService.java:verifyAndCreateRemoteLogDir(195)) - Remote Root 
> Log Dir [/app-logs] already exist, but with incorrect permissions. Expected: 
> [rwxrwxrwt], Found: [rwxrwxrwx]. The cluster may have problems with multiple 
> users.
> 1111336 2015-10-13 01:58:40,277 WARN  logaggregation.AppLogAggregatorImpl 
> (AppLogAggregatorImpl.java:<init>(182)) - rollingMonitorInterval is set as 
> -1. The log rolling mornitoring interval is disabled. The logs will be 
> aggregated after this application is finished.
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to