[ https://issues.apache.org/jira/browse/HDFS-958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16148519#comment-16148519 ]
Zhe Zhang edited comment on HDFS-958 at 8/31/17 6:34 AM: --------------------------------------------------------- Actually it does make sense to at least make it an option to avoid creating a {{FileStatus}} for each audit log. {{FSNamesystem#logAuditEvent}} only uses the {{FileStatus}} to log the permission, which is not really that necessary in many environments. In a busy cluster, 30~60K audit logs are written every second. This is a significant portion of GC pressure. was (Author: zhz): Actually it does make sense to at least make it an option to avoid creating a {{FileStatus}} for each audit log. {{FSNamesystem#logAuditEvent}} only uses the {{FileStatus}} to log the permission, which is not really that necessary in many environments. > Remove uneccessary creation of FileStatus objects in NameNode > ------------------------------------------------------------- > > Key: HDFS-958 > URL: https://issues.apache.org/jira/browse/HDFS-958 > Project: Hadoop HDFS > Issue Type: Improvement > Components: namenode > Reporter: Hairong Kuang > Assignee: Hairong Kuang > Attachments: reduceFileStatus.patch > > > NameNode creates FileStatus objects when > 1. write audit logs > 2. change file's lease > The uses of FileStatus in these places are not necessary. We could use INode > instead. -- This message was sent by Atlassian JIRA (v6.4.14#64029) --------------------------------------------------------------------- To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org