[
https://issues.apache.org/jira/browse/HDFS-4080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13482346#comment-13482346
]
Kihwal Lee commented on HDFS-4080:
----------------------------------
Thanks Nicholas. I think that will address most of problems for now. Once we
have locking refinements such as HDFS-3937, we will be able to do what Aaron
suggested as well.
> Add an option to disable block-level state change logging
> ---------------------------------------------------------
>
> Key: HDFS-4080
> URL: https://issues.apache.org/jira/browse/HDFS-4080
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: name-node
> Affects Versions: 3.0.0, 2.0.3-alpha
> Reporter: Kihwal Lee
>
> Although the block-level logging in namenode is useful for debugging, it can
> add a significant overhead to busy hdfs clusters since they are done while
> the namespace write lock is held. One example is shown in HDFS-4075. In this
> example, the write lock was held for 5 minutes while logging 11 million log
> messages for 5.5 million block invalidation events.
> It will be useful if we have an option to disable these block-level log
> messages and keep other state change messages going. If others feel that
> they can turned into DEBUG (with addition of isDebugEnabled() checks), that
> may also work too, but there might be people depending on the messages.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
