[
https://issues.apache.org/jira/browse/HDDS-9939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17815756#comment-17815756
]
Tsz-wo Sze commented on HDDS-9939:
----------------------------------
Just tried TestDatanodeUpgradeToScmHA.testFailedVolumeDuringFinalization. The
following directories were created under hadoop-hdds/container-service
afterward.
{code:java}
$ls -l hadoop-hdds/container-service
total 16
drwxr-xr-x@ 13 szetszwo staff 416 Feb 8 08:27 container.db
drwxr-xr-x@ 2 szetszwo staff 64 Feb 8 08:27 db.checkpoints
drwxr-xr-x@ 3 szetszwo staff 96 Feb 8 08:27 db.snapshots
{code}
It seems the db path was not set correctly in the test.
[~david666], you may run it using a debugger to trace down the code. Or you may
change the permission of hadoop-hdds/container-service to 555. Then, the
directory creation and the test will fail. It will show a useful stack trace.
{code:java}
2024-02-08 08:34:06,538 [main] ERROR utils.DatanodeStoreCache
(DatanodeStoreCache.java:getDB(88)) - Failed to get DB store
/Users/szetszwo/ozone/apache-ozone/hadoop-hdds/container-service/container.db
java.io.IOException: Failed init RocksDB, db path :
/Users/szetszwo/ozone/apache-ozone/hadoop-hdds/container-service/container.db,
exception :org.rocksdb.RocksDBException While mkdir if missing:
/Users/szetszwo/ozone/apache-ozone/hadoop-hdds/container-service/container.db:
Permission denied
at org.apache.hadoop.hdds.utils.db.RDBStore.<init>(RDBStore.java:184)
at
org.apache.hadoop.hdds.utils.db.DBStoreBuilder.build(DBStoreBuilder.java:229)
at
org.apache.hadoop.ozone.container.metadata.AbstractDatanodeStore.start(AbstractDatanodeStore.java:132)
at
org.apache.hadoop.ozone.container.metadata.AbstractDatanodeStore.<init>(AbstractDatanodeStore.java:94)
at
org.apache.hadoop.ozone.container.metadata.DatanodeStoreSchemaThreeImpl.<init>(DatanodeStoreSchemaThreeImpl.java:66)
at
org.apache.hadoop.ozone.container.common.utils.DatanodeStoreCache.getDB(DatanodeStoreCache.java:83)
at
org.apache.hadoop.ozone.container.keyvalue.helpers.BlockUtils.getDB(BlockUtils.java:133)
at
org.apache.hadoop.ozone.container.keyvalue.impl.BlockManagerImpl.persistPutBlock(BlockManagerImpl.java:107)
at
org.apache.hadoop.ozone.container.keyvalue.impl.BlockManagerImpl.putBlock(BlockManagerImpl.java:88)
at
org.apache.hadoop.ozone.container.keyvalue.KeyValueHandler.handlePutBlock(KeyValueHandler.java:548)
at
org.apache.hadoop.ozone.container.keyvalue.KeyValueHandler.dispatchRequest(KeyValueHandler.java:251)
at
org.apache.hadoop.ozone.container.keyvalue.KeyValueHandler.handle(KeyValueHandler.java:222)
at
org.apache.hadoop.ozone.container.common.impl.HddsDispatcher.dispatchRequest(HddsDispatcher.java:335)
at
org.apache.hadoop.ozone.container.common.impl.HddsDispatcher.lambda$dispatch$0(HddsDispatcher.java:183)
at
org.apache.hadoop.hdds.server.OzoneProtocolMessageDispatcher.processRequest(OzoneProtocolMessageDispatcher.java:89)
at
org.apache.hadoop.ozone.container.common.impl.HddsDispatcher.dispatch(HddsDispatcher.java:182)
at
org.apache.hadoop.ozone.container.upgrade.TestDatanodeUpgradeToScmHA.dispatchRequest(TestDatanodeUpgradeToScmHA.java:688)
at
org.apache.hadoop.ozone.container.upgrade.TestDatanodeUpgradeToScmHA.dispatchRequest(TestDatanodeUpgradeToScmHA.java:681)
at
org.apache.hadoop.ozone.container.upgrade.TestDatanodeUpgradeToScmHA.putBlock(TestDatanodeUpgradeToScmHA.java:596)
at
org.apache.hadoop.ozone.container.upgrade.TestDatanodeUpgradeToScmHA.testFailedVolumeDuringFinalization(TestDatanodeUpgradeToScmHA.java:307)
{code}
> Tests should not use hadoop-hdds/container-service
> --------------------------------------------------
>
> Key: HDDS-9939
> URL: https://issues.apache.org/jira/browse/HDDS-9939
> Project: Apache Ozone
> Issue Type: Improvement
> Components: test
> Reporter: Tsz-wo Sze
> Assignee: David
> Priority: Major
>
> The following tests create files or directories under
> hadoop-hdds/container-service.
> - TestDatanodeUpgradeToScmHA.testFailedVolumeDuringFinalization
> - TestKeyValueHandlerWithUnhealthyContainer
> {code}
> hadoop-hdds/container-service/0.container
> hadoop-hdds/container-service/container.db/
> {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
