[
https://issues.apache.org/jira/browse/YARN-742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13677050#comment-13677050
]
Kihwal Lee commented on YARN-742:
---------------------------------
I've noticed a new kind of HDFS integration failures recently. This time, it is
caused by TestNNThroughputBenchmark exiting prematurely. Will file a jira if
not reported already.
> Log aggregation causes a lot of redundant setPermission calls
> -------------------------------------------------------------
>
> Key: YARN-742
> URL: https://issues.apache.org/jira/browse/YARN-742
> Project: Hadoop YARN
> Issue Type: Bug
> Components: nodemanager
> Affects Versions: 0.23.7, 2.0.4-alpha
> Reporter: Kihwal Lee
> Assignee: Jason Lowe
> Fix For: 3.0.0, 2.1.0-beta, 0.23.9
>
> Attachments: YARN-742-1.branch-0.23.patch, YARN-742-1.patch,
> YARN-742.patch
>
>
> In one of our clusters, namenode RPC is spending 45% of its time on serving
> setPermission calls. Further investigation has revealed that most calls are
> redundantly made on /mapred/logs/<user>/logs. Also mkdirs calls are made
> before this.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
