[
https://issues.apache.org/jira/browse/HDDS-10650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17837807#comment-17837807
]
Ethan Rose commented on HDDS-10650:
-----------------------------------
Why is this targeted for 1.4.1? The PR is targeting the hsync feature branch
and 1.4.0 does not have hsync support.
> Deleting Volume/Bucket/Directory doesn't remove key from OpenKeyTable
> ---------------------------------------------------------------------
>
> Key: HDDS-10650
> URL: https://issues.apache.org/jira/browse/HDDS-10650
> Project: Apache Ozone
> Issue Type: Bug
> Components: OM
> Reporter: Pratyush Bhatt
> Assignee: Ashish Kumar
> Priority: Blocker
> Labels: pull-request-available
>
> *Iteration 1: Volume Level Delete: Doesnt remove entry from OpenKeyTable*
> Create a file _/hsyncvol/hsyncbuck/hsync/File_1.txt_ write some data, do
> hsync, and keep it open.
> File is visible in OpenKeyTable
> {noformat}
> ozone admin om lof --service-id=ozone1712159573 | grep File_1.txt
> 112214179318792293 1712252492047 Yes
> /hsyncvol/hsyncbuck/-9223372036851775231/File_1.txt{noformat}
> Delete the volume containing the file
> {noformat}
> ozone sh volume delete -r -y hsyncvol
> 24/04/04 17:42:11 INFO protocolPB.OmTransportFactory: Loading OM transport
> implementation
> org.apache.hadoop.ozone.om.protocolPB.Hadoop3OmTransportFactory as specified
> by configuration.
> 24/04/04 17:42:11 INFO client.ClientTrustManager: Loading certificates for
> client.
> 24/04/04 17:42:12 INFO protocolPB.OmTransportFactory: Loading OM transport
> implementation
> org.apache.hadoop.ozone.om.protocolPB.Hadoop3OmTransportFactory as specified
> by configuration.
> 24/04/04 17:42:12 INFO client.ClientTrustManager: Loading certificates for
> client.
> Volume hsyncvol is deleted{noformat}
> Still the file is present in OpenKeyTable
> {code:java}
> ozone admin om lof --service-id=ozone1712159573 | grep File_1.txt
> 112214179318792293 1712252492047 Yes
> /hsyncvol/hsyncbuck/-9223372036851775231/File_1.txt {code}
> {*}Iteration 2: Bucket Level Delete{*}{*}: Doesnt remove entry from
> OpenKeyTable{*}{*}{*}
> Again open the same file _/hsyncvol/hsyncbuck/hsync/File_1.txt_ , write some
> data, do hsync.
> File is visible in OpenKeyTable with a new ClientID
> {code:java}
> ozone admin om lof --service-id=ozone1712159573 | grep File_1.txt
> 112214183435108455 1712252554857 Yes
> /hsyncvol/hsyncbuck/-9223372036851769599/File_1.txt
> 112214179318792293 1712252492047 Yes
> /hsyncvol/hsyncbuck/-9223372036851775231/File_1.txt {code}
> Delete the Bucket containing the file
> {code:java}
> ozone fs -rm -r -skipTrash ofs://ozone1712159573//hsyncvol/hsyncbuck/
> 24/04/04 17:43:26 INFO protocolPB.OmTransportFactory: Loading OM transport
> implementation
> org.apache.hadoop.ozone.om.protocolPB.Hadoop3OmTransportFactory as specified
> by configuration.
> 24/04/04 17:43:27 INFO client.ClientTrustManager: Loading certificates for
> client.
> Deleted ofs://ozone1712159573/hsyncvol/hsyncbuck/ {code}
> Still the same OpenKeyTable
> {code:java}
> ozone admin om lof --service-id=ozone1712159573 | grep File_1.txt
> 112214183435108455 1712252554857 Yes
> /hsyncvol/hsyncbuck/-9223372036851769599/File_1.txt
> 112214179318792293 1712252492047 Yes
> /hsyncvol/hsyncbuck/-9223372036851775231/File_1.txt {code}
> {*}Iteration 3: Directory Level Delete{*}{*}: Doesnt remove entry from
> OpenKeyTable{*}{*}{*}
> Again open the same file _/hsyncvol/hsyncbuck/hsync/File_1.txt_ , write some
> data, do hsync.
> File is visible in OpenKeyTable with a new ClientID
> {code:java}
> ozone admin om lof --service-id=ozone1712159573 | grep File_1.txt
> 112214188917260394 1712252638507 Yes
> /hsyncvol/hsyncbuck/-9223372036851761407/File_1.txt
> 112214183435108455 1712252554857 Yes
> /hsyncvol/hsyncbuck/-9223372036851769599/File_1.txt
> 112214179318792293 1712252492047 Yes
> /hsyncvol/hsyncbuck/-9223372036851775231/File_1.txt {code}
> Delete the directory containing the file
> Still the same OpenKeyTable
> {code:java}
> ozone admin om lof --service-id=ozone1712159573 | grep File_1.txt
> 112214188917260394 1712252638507 Yes
> /hsyncvol/hsyncbuck/-9223372036851761407/File_1.txt
> 112214183435108455 1712252554857 Yes
> /hsyncvol/hsyncbuck/-9223372036851769599/File_1.txt
> 112214179318792293 1712252492047 Yes
> /hsyncvol/hsyncbuck/-9223372036851775231/File_1.txt {code}
> *Iteration 4: File Level Delete: Removes entry from OpenKeyTable*
> Again open the same file _/hsyncvol/hsyncbuck/hsync/File_1.txt_ , write some
> data, do hsync.
> File is visible in OpenKeyTable with a new ClientID
> {code:java}
> ozone admin om lof --service-id=ozone1712159573 | grep File_1.txt
> 112214201150865518 1712252825177 Yes
> /hsyncvol/hsyncbuck/-9223372036851751679/File_1.txt
> 112214188917260394 1712252638507 Yes
> /hsyncvol/hsyncbuck/-9223372036851761407/File_1.txt
> 112214183435108455 1712252554857 Yes
> /hsyncvol/hsyncbuck/-9223372036851769599/File_1.txt
> 112214179318792293 1712252492047 Yes
> /hsyncvol/hsyncbuck/-9223372036851775231/File_1.txt {code}
> Delete the file itself
> {code:java}
> ozone fs -rm -r -skipTrash
> ofs://ozone1712159573//hsyncvol/hsyncbuck/hsync/File_1.txt
> 24/04/04 17:47:45 INFO protocolPB.OmTransportFactory: Loading OM transport
> implementation
> org.apache.hadoop.ozone.om.protocolPB.Hadoop3OmTransportFactory as specified
> by configuration.
> 24/04/04 17:47:46 INFO client.ClientTrustManager: Loading certificates for
> client.
> Deleted ofs://ozone1712159573/hsyncvol/hsyncbuck/hsync/File_1.txt {code}
> This time the entry is removed from the OpenKeyTable
> {code:java}
> ozone admin om lof --service-id=ozone1712159573 | grep File_1.txt
> 112214188917260394 1712252638507 Yes
> /hsyncvol/hsyncbuck/-9223372036851761407/File_1.txt
> 112214183435108455 1712252554857 Yes
> /hsyncvol/hsyncbuck/-9223372036851769599/File_1.txt
> 112214179318792293 1712252492047 Yes
> /hsyncvol/hsyncbuck/-9223372036851775231/File_1.txt {code}
> *Summary:* Only deleting the file directly is removing the entry from the
> OpenKeyTable, rest are keeping it intact.
> *Expected Behavior:* Shouldn't it remove the entry in all the cases from the
> OpenKeyTable?
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
