[ 
https://issues.apache.org/jira/browse/HDDS-8893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Prashant Pogde resolved HDDS-8893.
----------------------------------
    Resolution: Not A Problem

> [snapshot] SnapshotDiff failed when write failure is injected in OM
> -------------------------------------------------------------------
>
>                 Key: HDDS-8893
>                 URL: https://issues.apache.org/jira/browse/HDDS-8893
>             Project: Apache Ozone
>          Issue Type: Bug
>          Components: Ozone Manager
>            Reporter: Jyotirmoy Sinha
>            Priority: Major
>              Labels: ozone-snapshot
>
> Steps -
>  # Inject write failure through Kraken on ozone.om.db.dirs or 
> ozone.metadata.dirs
>  # 
> Create volume, bucket, key.
>  # Perform snapshot operations such as createSnapshot, listSnapshot and 
> snapshotDiff
>  # 
> createSnapshot and listSnapshot runs properly but snapshotDiff fails with 
> below error -
> {code:java}
> 2023-06-20 14:59:10,645|INFO|MainThread|conftest.py:271 - 
> pytest_runtest_makereport()|call: <CallInfo when='call' exception: Ozone 
> snapshot snapdiff failed with output=[Caused by: 
> org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857)
>       ... 19 more
> Caused by: org.rocksdb.RocksDBException: While appending to file: 
> /mnt/var/lib/hadoop-ozone/om/ozone-metadata/db.snapdiff/000067.log: 
> Permission denied
>       at org.rocksdb.RocksDB.put(Native Method)
>       at org.rocksdb.RocksDB.put(RocksDB.java:857) {code}
>  
> Expected behaviour - OM Leader should failover on a healthy OM with no write 
> failure and snapshotDiff should process successfully.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]


Reply via email to