[
https://issues.apache.org/jira/browse/HDFS-15720?focusedWorklogId=522049&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-522049
]
ASF GitHub Bot logged work on HDFS-15720:
-----------------------------------------
Author: ASF GitHub Bot
Created on: 09/Dec/20 05:36
Start Date: 09/Dec/20 05:36
Worklog Time Spent: 10m
Work Description: Neilxzn commented on pull request #2532:
URL: https://github.com/apache/hadoop/pull/2532#issuecomment-741539742
@jojochuang It just provide options to modify log4j configuration when we
enable hdfs audit async logger.
In most scenarios, those configurations are irrelevant. But in high
concurrency scenarios, namenode will generate a lot of audit logs, and a large
amount of audit log output will affect the performance of namenode.
So in our production env, namenode generates 50w+ per min audit logs, we set
AsyncAppender Blocking (default value true) to false and buffersize (default
value 128) to 1024 to ensure namenode performance
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
-------------------
Worklog Id: (was: 522049)
Time Spent: 40m (was: 0.5h)
> namenode audit async logger should add some log4j config
> --------------------------------------------------------
>
> Key: HDFS-15720
> URL: https://issues.apache.org/jira/browse/HDFS-15720
> Project: Hadoop HDFS
> Issue Type: Improvement
> Components: hdfs
> Affects Versions: 3.3.0
> Environment: hadoop 3.3.0
> Reporter: Max Xie
> Priority: Minor
> Labels: pull-request-available
> Time Spent: 40m
> Remaining Estimate: 0h
>
> Hadoop project use log4j 1.2.x, we can't config some properties of logger in
> log4j.properties file , For example, AsyncAppender BufferSize and Blocking
> see https://logging.apache.org/log4j/1.2/apidocs/index.html.
> Namenode should add some audit async logger log4j config In order to
> facilitate the adjustment of log4j usage and audit log output performance
> adjustment.
> The new configuration is as follows
> dfs.namenode.audit.log.async.blocking false
> dfs.namenode.audit.log.async.buffer.size 128
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
