[
https://issues.apache.org/jira/browse/HDDS-9930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17799325#comment-17799325
]
Pratyush Bhatt commented on HDDS-9930:
--------------------------------------
Same scenario in HDFS, the hsync that happens after deleting the file, throws:
{code:java}
2023-12-21 09:21:20,650|INFO|Thread-46|machine.py:205 -
run()||GUID=f4628eb7-edd1-44c1-8b40-c14b63b4be29|checkDataLoss(org.hw.openfiles.TestOpenFile):
File does not exist: /tmp/folder_1703150407/File_0.txt (inode 65820) Holder
DFSClient_NONMAPREDUCE_-2133772079_1 does not have any open files. {code}
> Deleted file reappears after HSync
> ----------------------------------
>
> Key: HDDS-9930
> URL: https://issues.apache.org/jira/browse/HDDS-9930
> Project: Apache Ozone
> Issue Type: Sub-task
> Components: Ozone Manager
> Reporter: Pratyush Bhatt
> Assignee: Siyao Meng
> Priority: Critical
>
> Scenario:
> Open multiple FSO files in Ozone, write data and do Hsync. In middle Remove
> some file with -skipTrash.
> Before deleting File_98.txt and File_99.txt
> {code:java}
> [root@ccycloud-1 ~]# ozone fs -du -s -h
> ofs://ozone1702444879/testsyncvol1702619029/testsyncbuck1702619029/* | grep
> File_9
> 766 K 2.2 M
> ofs://ozone1702444879/testsyncvol1702619029/testsyncbuck1702619029/File_9.txt
> 766 K 2.2 M
> ofs://ozone1702444879/testsyncvol1702619029/testsyncbuck1702619029/File_90.txt
> 766 K 2.2 M
> ofs://ozone1702444879/testsyncvol1702619029/testsyncbuck1702619029/File_91.txt
> 766 K 2.2 M
> ofs://ozone1702444879/testsyncvol1702619029/testsyncbuck1702619029/File_92.txt
> 766 K 2.2 M
> ofs://ozone1702444879/testsyncvol1702619029/testsyncbuck1702619029/File_93.txt
> 766 K 2.2 M
> ofs://ozone1702444879/testsyncvol1702619029/testsyncbuck1702619029/File_94.txt
> 766 K 2.2 M
> ofs://ozone1702444879/testsyncvol1702619029/testsyncbuck1702619029/File_95.txt
> 766 K 2.2 M
> ofs://ozone1702444879/testsyncvol1702619029/testsyncbuck1702619029/File_96.txt
> 766 K 2.2 M
> ofs://ozone1702444879/testsyncvol1702619029/testsyncbuck1702619029/File_97.txt
> 766 K 2.2 M
> ofs://ozone1702444879/testsyncvol1702619029/testsyncbuck1702619029/File_98.txt
> 766 K 2.2 M
> ofs://ozone1702444879/testsyncvol1702619029/testsyncbuck1702619029/File_99.txt
> [root@ccycloud-1 ~]# {code}
> Removing both 98 and 99th file
> {code:java}
> [root@ccycloud-1 ~]# ozone fs -rm -r -skipTrash
> ofs://ozone1702444879/testsyncvol1702619029/testsyncbuck1702619029/File_99.txt
> Deleted
> ofs://ozone1702444879/testsyncvol1702619029/testsyncbuck1702619029/File_99.txt
> [root@ccycloud-1 ~]# ozone fs -rm -r -skipTrash
> ofs://ozone1702444879/testsyncvol1702619029/testsyncbuck1702619029/File_98.txt
> Deleted
> ofs://ozone1702444879/testsyncvol1702619029/testsyncbuck1702619029/File_98.txt
> [root@ccycloud-1 ~]# {code}
> File gets removed:
> {code:java}
> [root@ccycloud-1 ~]# ozone fs -du -s -h
> ofs://ozone1702444879/testsyncvol1702619029/testsyncbuck1702619029/* | grep
> File_9
> 766 K 2.2 M
> ofs://ozone1702444879/testsyncvol1702619029/testsyncbuck1702619029/File_9.txt
> 766 K 2.2 M
> ofs://ozone1702444879/testsyncvol1702619029/testsyncbuck1702619029/File_90.txt
> 766 K 2.2 M
> ofs://ozone1702444879/testsyncvol1702619029/testsyncbuck1702619029/File_91.txt
> 766 K 2.2 M
> ofs://ozone1702444879/testsyncvol1702619029/testsyncbuck1702619029/File_92.txt
> 766 K 2.2 M
> ofs://ozone1702444879/testsyncvol1702619029/testsyncbuck1702619029/File_93.txt
> 766 K 2.2 M
> ofs://ozone1702444879/testsyncvol1702619029/testsyncbuck1702619029/File_94.txt
> 766 K 2.2 M
> ofs://ozone1702444879/testsyncvol1702619029/testsyncbuck1702619029/File_95.txt
> 766 K 2.2 M
> ofs://ozone1702444879/testsyncvol1702619029/testsyncbuck1702619029/File_96.txt
> 766 K 2.2 M
> ofs://ozone1702444879/testsyncvol1702619029/testsyncbuck1702619029/File_97.txt
> [root@ccycloud-1 ~]#
> [root@ccycloud-1 ~]# {code}
> After the next Hsync call in test, Both file reappears with the exact length
> as if they were not deleted previously.
> {code:java}
> [root@ccycloud-1 ~]# ozone fs -du -s -h
> ofs://ozone1702444879/testsyncvol1702619029/testsyncbuck1702619029/* | grep
> File_9
> 771 K 2.3 M
> ofs://ozone1702444879/testsyncvol1702619029/testsyncbuck1702619029/File_9.txt
> 771 K 2.3 M
> ofs://ozone1702444879/testsyncvol1702619029/testsyncbuck1702619029/File_90.txt
> 771 K 2.3 M
> ofs://ozone1702444879/testsyncvol1702619029/testsyncbuck1702619029/File_91.txt
> 771 K 2.3 M
> ofs://ozone1702444879/testsyncvol1702619029/testsyncbuck1702619029/File_92.txt
> 771 K 2.3 M
> ofs://ozone1702444879/testsyncvol1702619029/testsyncbuck1702619029/File_93.txt
> 771 K 2.3 M
> ofs://ozone1702444879/testsyncvol1702619029/testsyncbuck1702619029/File_94.txt
> 771 K 2.3 M
> ofs://ozone1702444879/testsyncvol1702619029/testsyncbuck1702619029/File_95.txt
> 771 K 2.3 M
> ofs://ozone1702444879/testsyncvol1702619029/testsyncbuck1702619029/File_96.txt
> 771 K 2.3 M
> ofs://ozone1702444879/testsyncvol1702619029/testsyncbuck1702619029/File_97.txt
> 771 K 2.3 M
> ofs://ozone1702444879/testsyncvol1702619029/testsyncbuck1702619029/File_98.txt
> 771 K 2.3 M
> ofs://ozone1702444879/testsyncvol1702619029/testsyncbuck1702619029/File_99.txt
> {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
