[
https://issues.apache.org/jira/browse/HADOOP-3520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Konstantin Shvachko updated HADOOP-3520:
----------------------------------------
Attachment: failure.log
Attaching the log of the failed test and a link to the Hudson build that
generated it:
http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2621/testReport/org.apache.hadoop.dfs/TestDFSUpgradeFromImage/testUpgradeFromImage/
It's also worth noting that there is another NPE in the log, which may the
cause of the previous one:
{code}
2008-06-07 02:37:00,428 ERROR dfs.DataNode (UpgradeObjectDatanode.java:run(97))
- java.lang.NullPointerException
at
org.apache.hadoop.dfs.GenerationStampUpgradeDatanode.doUpgrade(GenerationStampUpgrade.java:291)
at
org.apache.hadoop.dfs.UpgradeObjectDatanode.run(UpgradeObjectDatanode.java:95)
at java.lang.Thread.run(Thread.java:595)
{code}
The NPE in UpgradeManagerDatanode.initializeUpgrade() should not happen,
because with currentUpgrades == null
the method should exit after super.initializeUpgrade().
I think this is a synchronization issue, because
UpgradeManagerDatanode.initializeUpgrade() is not synchronized.
If this can happen only when using MiniDFSCluster then we shoulddowngrade this
issue and fix it later.
Marking it for 0.18 for now.
> Generation stamp upgrade fails TestDFSUpgradeFromImage
> ------------------------------------------------------
>
> Key: HADOOP-3520
> URL: https://issues.apache.org/jira/browse/HADOOP-3520
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs
> Affects Versions: 0.18.0
> Reporter: Konstantin Shvachko
> Fix For: 0.18.0
>
> Attachments: failure.log
>
>
> TestDFSUpgradeFromImage occasionally fails doing distributed upgrade related
> to generation stamps with the following NPE:
> {code}
> java.lang.NullPointerException
> at
> org.apache.hadoop.dfs.UpgradeManagerDatanode.initializeUpgrade(UpgradeManagerDatanode.java:54)
> at
> org.apache.hadoop.dfs.DataStorage.verifyDistributedUpgradeProgress(DataStorage.java:402)
> at org.apache.hadoop.dfs.DataStorage.doTransition(DataStorage.java:232)
> at
> org.apache.hadoop.dfs.DataStorage.recoverTransitionRead(DataStorage.java:139)
> at org.apache.hadoop.dfs.DataNode.startDataNode(DataNode.java:268)
> at org.apache.hadoop.dfs.DataNode.<init>(DataNode.java:185)
> at org.apache.hadoop.dfs.DataNode.makeInstance(DataNode.java:2952)
> at
> org.apache.hadoop.dfs.DataNode.instantiateDataNode(DataNode.java:2907)
> at
> org.apache.hadoop.dfs.MiniDFSCluster.startDataNodes(MiniDFSCluster.java:401)
> at org.apache.hadoop.dfs.MiniDFSCluster.<init>(MiniDFSCluster.java:267)
> at org.apache.hadoop.dfs.MiniDFSCluster.<init>(MiniDFSCluster.java:162)
> at
> org.apache.hadoop.dfs.TestDFSUpgradeFromImage.testUpgradeFromImage(TestDFSUpgradeFromImage.java:180)
> {code}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
