[
https://issues.apache.org/jira/browse/HDDS-10149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17810086#comment-17810086
]
Hemant Kumar commented on HDDS-10149:
-------------------------------------
[~smeng] I agree with you that RocksDB's native tool is supposed to be
read-only but based on the run, it feels like RocksDB's native tool is not just
reading the file.
We have four implements
([TestOmSnapshotFsoWithNativeLib|https://github.com/apache/ozone/blob/master/hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/om/snapshot/TestOmSnapshotFsoWithNativeLib.java)],
[TestOmSnapshotFsoWithoutNativeLib|https://github.com/apache/ozone/blob/master/hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/om/snapshot/TestOmSnapshotFsoWithoutNativeLib.java],
[TestOmSnapshotLegacy|https://github.com/apache/ozone/blob/master/hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/om/snapshot/TestOmSnapshotLegacy.java],
[TestOmSnapshotObjectStore|https://github.com/apache/ozone/blob/master/hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/om/snapshot/TestOmSnapshotObjectStore.java])
of
[TestOmSnapshot|https://github.com/apache/ozone/blob/master/hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/om/snapshot/TestOmSnapshot.java]
and only
[TestOmSnapshotFsoWithNativeLib|https://github.com/apache/ozone/blob/master/hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/om/snapshot/TestOmSnapshotFsoWithNativeLib.java)]
fails when it is properly executed with
[{{@Native}}|https://github.com/apache/ozone/commit/5f98b1b67abde44156d6c210e6abe99d010e0e15].
> Bad file descriptor in
> TestOmSnapshotFsoWithNativeLib.testSnapshotCompactionDag
> -------------------------------------------------------------------------------
>
> Key: HDDS-10149
> URL: https://issues.apache.org/jira/browse/HDDS-10149
> Project: Apache Ozone
> Issue Type: Bug
> Components: Snapshot
> Reporter: Attila Doroszlai
> Assignee: Swaminathan Balachandran
> Priority: Critical
> Attachments: native.log,
> org.apache.hadoop.ozone.om.snapshot.TestOmSnapshotFsoWithNativeLib-output.txt,
> org.apache.hadoop.ozone.om.snapshot.TestOmSnapshotFsoWithNativeLib.txt
>
>
> {{TestOmSnapshotFsoWithNativeLib}} failed in a CI run where it was really
> using the native library:
> {code}
> org.apache.hadoop.ozone.om.snapshot.TestOmSnapshotFsoWithNativeLib.testSnapshotCompactionDag
> -- Time elapsed: 2.844 s <<< ERROR!
> java.io.IOException:
> RocksDatabase[/home/runner/work/ozone/ozone/hadoop-ozone/integration-test/target/test-dir/MiniOzoneClusterImpl-d6a9ee09-9b79-4e8b-9241-4df752521eb9/ozone-meta/om.db]:
> Failed to compactRange; status : IOError; message : While pread offset 0 len
> 176:
> /home/runner/work/ozone/ozone/hadoop-ozone/integration-test/target/test-dir/MiniOzoneClusterImpl-d6a9ee09-9b79-4e8b-9241-4df752521eb9/ozone-meta/om.db/000508.sst:
> Bad file descriptor
> at
> org.apache.hadoop.hdds.utils.HddsServerUtil.toIOException(HddsServerUtil.java:667)
> at
> org.apache.hadoop.hdds.utils.db.RocksDatabase.toIOException(RocksDatabase.java:98)
> at
> org.apache.hadoop.hdds.utils.db.RocksDatabase.compactRange(RocksDatabase.java:595)
> at
> org.apache.hadoop.hdds.utils.db.RocksDatabase.compactDB(RocksDatabase.java:551)
> at org.apache.hadoop.hdds.utils.db.RDBStore.compactDB(RDBStore.java:216)
> at
> org.apache.hadoop.ozone.om.snapshot.TestOmSnapshot.testSnapshotCompactionDag(TestOmSnapshot.java:2415)
> at java.lang.reflect.Method.invoke(Method.java:498)
> at java.util.ArrayList.forEach(ArrayList.java:1259)
> at java.util.ArrayList.forEach(ArrayList.java:1259)
> Caused by: org.rocksdb.RocksDBException: While pread offset 0 len 176:
> /home/runner/work/ozone/ozone/hadoop-ozone/integration-test/target/test-dir/MiniOzoneClusterImpl-d6a9ee09-9b79-4e8b-9241-4df752521eb9/ozone-meta/om.db/000508.sst:
> Bad file descriptor
> at org.rocksdb.RocksDB.compactRange(Native Method)
> at org.rocksdb.RocksDB.compactRange(RocksDB.java:3416)
> at
> org.apache.hadoop.hdds.utils.db.RocksDatabase.compactRange(RocksDatabase.java:592)
> ... 6 more
> {code}
> CC [~smeng], [~hemantk]
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
