[
https://issues.apache.org/jira/browse/HDFS-5241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13777422#comment-13777422
]
Nathan Roberts commented on HDFS-5241:
--------------------------------------
+1 on the approach. The thread pulling from the queue will also get some very
nice affinity which keeps it moving very efficiently through the log4j layer.
It's very nice to see the namenode utilizing several cores at once! Still
looking for that 1600% on a 16 core box, but this is certainly a large step
towards that.
> Provide alternate queuing audit logger to reduce logging contention
> -------------------------------------------------------------------
>
> Key: HDFS-5241
> URL: https://issues.apache.org/jira/browse/HDFS-5241
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: namenode
> Affects Versions: 2.0.0-alpha, 3.0.0
> Reporter: Daryn Sharp
> Assignee: Daryn Sharp
> Attachments: HDFS-5241.patch
>
>
> The default audit logger has extremely poor performance. The internal
> synchronization of log4j causes massive contention between the call handlers
> (100 by default) which drastically limits the throughput of the NN.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
