[
https://issues.apache.org/jira/browse/HDFS-15227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17060252#comment-17060252
]
Ayush Saxena commented on HDFS-15227:
-------------------------------------
Thanx [[email protected]] for the report, Was able to reproduce this.
The reason being if dfs.namenode.file.close.num-committed-allowed is 1, so it
allows to close the file even when the block is in committed state(not complete)
The NPE happens in a very rare condition :
If IBR for the last block comes post the if check here :
{code:java}
//display under construction block info.
if (!blocks.isLastBlockComplete() && lastBlock != null) {
ExtendedBlock block = lastBlock.getBlock();
// IBR Comes here and marks the block complete from committed state. Hence
making uc null
{code}
Will put up a fix adding the null check
> FSCK -upgradedomains is failing for upgradedomains when more than 2 million
> blocks present in hdfs and write in progress of some blocks
> ---------------------------------------------------------------------------------------------------------------------------------------
>
> Key: HDFS-15227
> URL: https://issues.apache.org/jira/browse/HDFS-15227
> Project: Hadoop HDFS
> Issue Type: Bug
> Reporter: krishna reddy
> Assignee: Ayush Saxena
> Priority: Major
>
> FSCK -upgradedomains is failing for upgradedomains when more than 2 million
> blocks present in hdfs and write in progress of some blocks
> "hdfs fsck / -files -blocks -upgradedomains"
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
