[
https://issues.apache.org/jira/browse/HDFS-12440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16164214#comment-16164214
]
Weiwei Yang edited comment on HDFS-12440 at 9/13/17 7:01 AM:
-------------------------------------------------------------
It looks like the UT was failing because dfs test dir gets conflicts, I saw
following error message in the log
{noformat}
[main] INFO ozone.MiniOzoneCluster (MiniOzoneCluster.java:setConf(125)) -
dn2: set dfs.container.ratis.datanode.storage.dir =
/testptch/hadoop/hadoop-hdfs-project/hadoop-hdfs/target/test/data/3/dfs/data/dn2_data-1
...
[main] INFO hdfs.MiniDFSCluster (MiniDFSCluster.java:startDataNodes(1596)) -
Starting DataNode 2 with dfs.datanode.data.dir:
[DISK]file:/testptch/hadoop/hadoop-hdfs-project/hadoop-hdfs/target/test/data/3/dfs/data/dn2_data0,[DISK]file:/testptch/hadoop/hadoop-hdfs-project/hadoop-hdfs/target/test/data/3/dfs/data/dn2_data1
{noformat}
then ...
{noformat}
2017-09-11 10:54:32,297 [Thread-176] INFO common.Storage
(Storage.java:lock(813)) - Cannot lock storage
/testptch/hadoop/hadoop-hdfs-project/hadoop-hdfs/target/test/data/3/dfs/data/dn0_data1.
The directory is already locked
2017-09-11 10:54:32,301 [Thread-176] WARN common.Storage
(DataStorage.java:loadDataStorage(410)) - Failed to add storage directory
[DISK]file:/testptch/hadoop/hadoop-hdfs-project/hadoop-hdfs/target/test/data/3/dfs/data/dn0_data1
java.io.IOException: Cannot lock storage
/testptch/hadoop/hadoop-hdfs-project/hadoop-hdfs/target/test/data/3/dfs/data/dn0_data1.
The directory is already locked
at
org.apache.hadoop.hdfs.server.common.Storage$StorageDirectory.lock(Storage.java:814)
at
org.apache.hadoop.hdfs.server.common.Storage$StorageDirectory.analyzeStorage(Storage.java:622)
at
org.apache.hadoop.hdfs.server.datanode.DataStorage.loadStorageDirectory(DataStorage.java:262)
at
org.apache.hadoop.hdfs.server.datanode.DataStorage.loadDataStorage(DataStorage.java:399)
at
org.apache.hadoop.hdfs.server.datanode.DataStorage.addStorageLocations(DataStorage.java:379)
at
org.apache.hadoop.hdfs.server.datanode.DataStorage.recoverTransitionRead(DataStorage.java:544)
at
org.apache.hadoop.hdfs.server.datanode.DataNode.initStorage(DataNode.java:1731)
at
org.apache.hadoop.hdfs.server.datanode.DataNode.initBlockPool(DataNode.java:1691)
at
org.apache.hadoop.hdfs.server.datanode.BPOfferService.verifyAndSetNamespaceInfo(BPOfferService.java:376)
at
org.apache.hadoop.hdfs.server.datanode.BPServiceActor.connectToNNAndHandshake(BPServiceActor.java:280)
at
org.apache.hadoop.hdfs.server.datanode.BPServiceActor.run(BPServiceActor.java:816)
at java.lang.Thread.run(Thread.java:748)
{noformat}
was (Author: cheersyang):
It looks like the UT was failing because dfs test dir gets conflicts, I saw
following error message in the log
{noformat}
[main] INFO ozone.MiniOzoneCluster (MiniOzoneCluster.java:setConf(125)) -
dn2: set dfs.container.ratis.datanode.storage.dir =
/testptch/hadoop/hadoop-hdfs-project/hadoop-hdfs/target/test/data/3/dfs/data/dn2_data-1
{noformat}
then ...
{noformat}
2017-09-11 10:54:32,297 [Thread-176] INFO common.Storage
(Storage.java:lock(813)) - Cannot lock storage
/testptch/hadoop/hadoop-hdfs-project/hadoop-hdfs/target/test/data/3/dfs/data/dn0_data1.
The directory is already locked
2017-09-11 10:54:32,301 [Thread-176] WARN common.Storage
(DataStorage.java:loadDataStorage(410)) - Failed to add storage directory
[DISK]file:/testptch/hadoop/hadoop-hdfs-project/hadoop-hdfs/target/test/data/3/dfs/data/dn0_data1
java.io.IOException: Cannot lock storage
/testptch/hadoop/hadoop-hdfs-project/hadoop-hdfs/target/test/data/3/dfs/data/dn0_data1.
The directory is already locked
at
org.apache.hadoop.hdfs.server.common.Storage$StorageDirectory.lock(Storage.java:814)
at
org.apache.hadoop.hdfs.server.common.Storage$StorageDirectory.analyzeStorage(Storage.java:622)
at
org.apache.hadoop.hdfs.server.datanode.DataStorage.loadStorageDirectory(DataStorage.java:262)
at
org.apache.hadoop.hdfs.server.datanode.DataStorage.loadDataStorage(DataStorage.java:399)
at
org.apache.hadoop.hdfs.server.datanode.DataStorage.addStorageLocations(DataStorage.java:379)
at
org.apache.hadoop.hdfs.server.datanode.DataStorage.recoverTransitionRead(DataStorage.java:544)
at
org.apache.hadoop.hdfs.server.datanode.DataNode.initStorage(DataNode.java:1731)
at
org.apache.hadoop.hdfs.server.datanode.DataNode.initBlockPool(DataNode.java:1691)
at
org.apache.hadoop.hdfs.server.datanode.BPOfferService.verifyAndSetNamespaceInfo(BPOfferService.java:376)
at
org.apache.hadoop.hdfs.server.datanode.BPServiceActor.connectToNNAndHandshake(BPServiceActor.java:280)
at
org.apache.hadoop.hdfs.server.datanode.BPServiceActor.run(BPServiceActor.java:816)
at java.lang.Thread.run(Thread.java:748)
{noformat}
> Ozone: TestAllocateContainer fails on jenkins
> ---------------------------------------------
>
> Key: HDFS-12440
> URL: https://issues.apache.org/jira/browse/HDFS-12440
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: ozone
> Affects Versions: HDFS-7240
> Reporter: Weiwei Yang
> Assignee: Weiwei Yang
> Priority: Minor
>
> I am seeing this failure in [this jenkins
> report|https://builds.apache.org/job/PreCommit-HDFS-Build/21067/testReport/org.apache.hadoop.ozone.scm/TestAllocateContainer/org_apache_hadoop_ozone_scm_TestAllocateContainer/],
> with following error
> {noformat}
> Stacktrace
> java.lang.NullPointerException: null
> at
> org.apache.hadoop.hdfs.MiniDFSCluster.setDataNodeStorageCapacities(MiniDFSCluster.java:1715)
> at
> org.apache.hadoop.hdfs.MiniDFSCluster.setDataNodeStorageCapacities(MiniDFSCluster.java:1694)
> at
> org.apache.hadoop.hdfs.MiniDFSCluster.startDataNodes(MiniDFSCluster.java:1674)
> at
> org.apache.hadoop.hdfs.MiniDFSCluster.initMiniDFSCluster(MiniDFSCluster.java:882)
> at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:494)
> at
> org.apache.hadoop.ozone.MiniOzoneCluster.<init>(MiniOzoneCluster.java:98)
> at
> org.apache.hadoop.ozone.MiniOzoneCluster.<init>(MiniOzoneCluster.java:77)
> at
> org.apache.hadoop.ozone.MiniOzoneCluster$Builder.build(MiniOzoneCluster.java:441)
> at
> org.apache.hadoop.ozone.scm.TestAllocateContainer.init(TestAllocateContainer.java:56)
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
