[
https://issues.apache.org/jira/browse/HDFS-761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12776130#action_12776130
]
Suresh Srinivas commented on HDFS-761:
--------------------------------------
Here is the exception thrown when the problem occurred:
2009-11-09 21:54:24,671 ERROR
org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode: Exception in
doCheckpoint:
2009-11-09 21:54:24,671 ERROR
org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode:
org.apache.hadoop.hdfs.protocol.DSQuotaExceededException: The DiskSpace quota
of ***** is exceeded:
quota=13194139533312 diskspace consumed=40821.3g
at
org.apache.hadoop.hdfs.server.namenode.INodeDirectoryWithQuota.verifyQuota(INodeDirectoryWithQuota.java:149)
at
org.apache.hadoop.hdfs.server.namenode.FSDirectory.verifyQuota(FSDirectory.java:1025)
at
org.apache.hadoop.hdfs.server.namenode.FSDirectory.verifyQuotaForRename(FSDirectory.java:1051)
at
org.apache.hadoop.hdfs.server.namenode.FSDirectory.unprotectedRenameTo(FSDirectory.java:409)
at
org.apache.hadoop.hdfs.server.namenode.FSEditLog.loadFSEdits(FSEditLog.java:658)
at
org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSEdits(FSImage.java:992)
at
org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.doMerge(SecondaryNameNode.java:590)
at
org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.access$000(SecondaryNameNode.java:473)
at
org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doMerge(SecondaryNameNode.java:350)
at
org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doCheckpoint(SecondaryNameNode.java:314)
at
org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.run(SecondaryNameNode.java:225)
at java.lang.Thread.run(Thread.java:619)
> Failure to process rename operation from edits log due to quota verification
> ----------------------------------------------------------------------------
>
> Key: HDFS-761
> URL: https://issues.apache.org/jira/browse/HDFS-761
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: name-node
> Affects Versions: 0.20.2, 0.21.0, 0.22.0
> Reporter: Suresh Srinivas
> Assignee: Suresh Srinivas
> Fix For: 0.20.2, 0.21.0, 0.22.0
>
> Attachments: hdfs-761.patch
>
>
> When processing edits log, quota verification is not done and the used quota
> for directories is not updated. The update is done at the end of processing
> edits log. This rule is broken by change introduced in HDFS-677. This causes
> namenode from handling rename operation from edits log due to quota
> verification failure. Once this happens, namenode does not proceed edits log
> any further. This results in check point failure on backup node or secondary
> namenode. This also prevents namenode from coming up.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
