[
https://issues.apache.org/jira/browse/HDDS-11528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jyotirmoy Sinha updated HDDS-11528:
-----------------------------------
Description:
Exclusive size of snapshot is always showing 0
Scenario :
* Key size - 1MB
* Create snap0 - empty
* Create snap1 - key1
* Create snap2 - key1
* Create snap3 - key1, key2
* Create snap4 - key1, key2(renamed)
* Create snap5 - key1 [key2 deleted]
* Delete snap2 and snap4
* Create snap6 - key1, key3
* Create snap7 - key1 [key3 deleted]
* Check exclusive size of snap6 - its reflected as 0, although it exclusively
holds key3
* Check exclusive size of snap3 - its reflected as 0, although it exclusively
holds key2, , since other snapshot which hold key2 are deleted - snap4
Snapshot info of snap3 -
{code:java}
# ozone sh snapshot info vol-n1fu0/buck-tin1a snap-ton6m
{
"volumeName" : "vol-n1fu0",
"bucketName" : "buck-tin1a",
"name" : "snap-ton6m",
"creationTime" : 1727997314792,
"snapshotStatus" : "SNAPSHOT_ACTIVE",
"snapshotId" : "0b731ad8-e256-42c1-9fdc-2a3ae22dedbc",
"snapshotPath" : "vol-n1fu0/buck-tin1a",
"checkpointDir" : "-0b731ad8-e256-42c1-9fdc-2a3ae22dedbc",
"referencedSize" : 362807296,
"referencedReplicatedSize" : 1088421888,
"exclusiveSize" : 0,
"exclusiveReplicatedSize" : 0
} {code}
Snapshot info of snap6 -
{code:java}
# ozone sh snapshot info vol-n1fu0/buck-tin1a snap-8barh
{
"volumeName" : "vol-n1fu0",
"bucketName" : "buck-tin1a",
"name" : "snap-8barh",
"creationTime" : 1727997400069,
"snapshotStatus" : "SNAPSHOT_ACTIVE",
"snapshotId" : "ddf4e855-c3fb-4026-8a42-6dfe73bfd858",
"snapshotPath" : "vol-n1fu0/buck-tin1a",
"checkpointDir" : "-ddf4e855-c3fb-4026-8a42-6dfe73bfd858",
"referencedSize" : 362807296,
"referencedReplicatedSize" : 1088421888,
"exclusiveSize" : 0,
"exclusiveReplicatedSize" : 0
} {code}
All snapshot contents -
{code:java}
# ozone fs -ls -R ofs://ozone1727943432/vol-n1fu0/buck-tin1a/.snapshot
drwxrwxrwx - hrt_qa hrt_qa 0 2024-10-03 23:14
ofs://ozone1727943432/vol-n1fu0/buck-tin1a/.snapshot/snap-34qcr
drwxrwxrwx - hrt_qa hrt_qa 362807296 2024-10-03 23:16
ofs://ozone1727943432/vol-n1fu0/buck-tin1a/.snapshot/snap-8barh
-rw-rw-rw- 3 hrt_qa om 181403648 2024-10-03 23:14
ofs://ozone1727943432/vol-n1fu0/buck-tin1a/.snapshot/snap-8barh/key_1727997247
-rw-rw-rw- 3 hrt_qa om 181403648 2024-10-03 23:16
ofs://ozone1727943432/vol-n1fu0/buck-tin1a/.snapshot/snap-8barh/key_1727997378
drwxrwxrwx - hrt_qa hrt_qa 181403648 2024-10-03 23:14
ofs://ozone1727943432/vol-n1fu0/buck-tin1a/.snapshot/snap-bz1a9
-rw-rw-rw- 3 hrt_qa om 181403648 2024-10-03 23:14
ofs://ozone1727943432/vol-n1fu0/buck-tin1a/.snapshot/snap-bz1a9/key_1727997247
drwxrwxrwx - hrt_qa hrt_qa 362807296 2024-10-03 23:15
ofs://ozone1727943432/vol-n1fu0/buck-tin1a/.snapshot/snap-ton6m
-rw-rw-rw- 3 hrt_qa om 181403648 2024-10-03 23:14
ofs://ozone1727943432/vol-n1fu0/buck-tin1a/.snapshot/snap-ton6m/key_1727997247
-rw-rw-rw- 3 hrt_qa om 181403648 2024-10-03 23:15
ofs://ozone1727943432/vol-n1fu0/buck-tin1a/.snapshot/snap-ton6m/key_1727997298
drwxrwxrwx - hrt_qa hrt_qa 181403648 2024-10-03 23:15
ofs://ozone1727943432/vol-n1fu0/buck-tin1a/.snapshot/snap-vsiih
-rw-rw-rw- 3 hrt_qa om 181403648 2024-10-03 23:14
ofs://ozone1727943432/vol-n1fu0/buck-tin1a/.snapshot/snap-vsiih/key_1727997247
drwxrwxrwx - hrt_qa hrt_qa 181403648 2024-10-03 23:16
ofs://ozone1727943432/vol-n1fu0/buck-tin1a/.snapshot/snap-wk1to
-rw-rw-rw- 3 hrt_qa om 181403648 2024-10-03 23:14
ofs://ozone1727943432/vol-n1fu0/buck-tin1a/.snapshot/snap-wk1to/key_1727997247
{code}
was:
Exclusive size is calculated incorrectly during unordered deletion of snapshots
Scenario :
* Key size - 1MB
* Create snap0 - empty
* Create snap1 - key1
* Create snap2 - key1
* Create snap3 - key1, key2
* Create snap4 - key1, key2(renamed)
* Create snap5 - key1 [key2 deleted]
* Delete snap2 and snap4
* Create snap6 - key1, key3
* Create snap7 - key1 [key3 deleted]
* Check exclusive size of snap3 - its reflected as 2MB (key1+key2), although
it exclusively only holds key2. key1 is mutually shared between snap1, snap3,
snap5, snap6, snap7
Snapshot info of snap3 -
{code:java}
# ozone sh snapshot info vol-wcqc9/buck-35ed8 snap-z7a1k
{
"volumeName" : "vol-wcqc9",
"bucketName" : "buck-35ed8",
"name" : "snap-z7a1k",
"creationTime" : 1720723332820,
"snapshotStatus" : "SNAPSHOT_ACTIVE",
"snapshotId" : "704329ea-8d36-4365-b4aa-327c513a31f3",
"snapshotPath" : "vol-wcqc9/buck-35ed8",
"checkpointDir" : "-704329ea-8d36-4365-b4aa-327c513a31f3",
"referencedSize" : 352321536,
"referencedReplicatedSize" : 1056964608,
"exclusiveSize" : 352321536,
"exclusiveReplicatedSize" : 1056964608
} {code}
Contents of all active snapshots -
{code:java}
# ozone fs -ls -R ofs://ozone1720685794/vol-wcqc9/buck-35ed8/.snapshot
drwxrwxrwx - hrt_qa hrt_qa 352321536 2024-07-11 18:43
ofs://ozone1720685794/vol-wcqc9/buck-35ed8/.snapshot/snap-0bdi0
-rw-rw-rw- 3 hrt_qa om 176160768 2024-07-11 18:41
ofs://ozone1720685794/vol-wcqc9/buck-35ed8/.snapshot/snap-0bdi0/key_1720723285
-rw-rw-rw- 3 hrt_qa om 176160768 2024-07-11 18:43
ofs://ozone1720685794/vol-wcqc9/buck-35ed8/.snapshot/snap-0bdi0/key_1720723390
drwxrwxrwx - hrt_qa hrt_qa 0 2024-07-11 18:41
ofs://ozone1720685794/vol-wcqc9/buck-35ed8/.snapshot/snap-8ziwu
drwxrwxrwx - hrt_qa hrt_qa 176160768 2024-07-11 18:41
ofs://ozone1720685794/vol-wcqc9/buck-35ed8/.snapshot/snap-96uv4
-rw-rw-rw- 3 hrt_qa om 176160768 2024-07-11 18:41
ofs://ozone1720685794/vol-wcqc9/buck-35ed8/.snapshot/snap-96uv4/key_1720723285
drwxrwxrwx - hrt_qa hrt_qa 176160768 2024-07-11 18:43
ofs://ozone1720685794/vol-wcqc9/buck-35ed8/.snapshot/snap-lm5g3
-rw-rw-rw- 3 hrt_qa om 176160768 2024-07-11 18:41
ofs://ozone1720685794/vol-wcqc9/buck-35ed8/.snapshot/snap-lm5g3/key_1720723285
drwxrwxrwx - hrt_qa hrt_qa 176160768 2024-07-11 18:42
ofs://ozone1720685794/vol-wcqc9/buck-35ed8/.snapshot/snap-w3y2g
-rw-rw-rw- 3 hrt_qa om 176160768 2024-07-11 18:41
ofs://ozone1720685794/vol-wcqc9/buck-35ed8/.snapshot/snap-w3y2g/key_1720723285
drwxrwxrwx - hrt_qa hrt_qa 352321536 2024-07-11 18:42
ofs://ozone1720685794/vol-wcqc9/buck-35ed8/.snapshot/snap-z7a1k
-rw-rw-rw- 3 hrt_qa om 176160768 2024-07-11 18:41
ofs://ozone1720685794/vol-wcqc9/buck-35ed8/.snapshot/snap-z7a1k/key_1720723285
-rw-rw-rw- 3 hrt_qa om 176160768 2024-07-11 18:42
ofs://ozone1720685794/vol-wcqc9/buck-35ed8/.snapshot/snap-z7a1k/key_1720723319
[[email protected] ~]# ozone fs -ls -R
ofs://ozone1720685794/vol-wcqc9/buck-35ed8/ {code}
> [snapshot] Exclusive size of snapshot is always showing 0
> ---------------------------------------------------------
>
> Key: HDDS-11528
> URL: https://issues.apache.org/jira/browse/HDDS-11528
> Project: Apache Ozone
> Issue Type: Bug
> Components: Snapshot
> Reporter: Jyotirmoy Sinha
> Priority: Major
> Labels: ozone-snapshot
>
> Exclusive size of snapshot is always showing 0
> Scenario :
> * Key size - 1MB
> * Create snap0 - empty
> * Create snap1 - key1
> * Create snap2 - key1
> * Create snap3 - key1, key2
> * Create snap4 - key1, key2(renamed)
> * Create snap5 - key1 [key2 deleted]
> * Delete snap2 and snap4
> * Create snap6 - key1, key3
> * Create snap7 - key1 [key3 deleted]
> * Check exclusive size of snap6 - its reflected as 0, although it
> exclusively holds key3
> * Check exclusive size of snap3 - its reflected as 0, although it
> exclusively holds key2, , since other snapshot which hold key2 are deleted -
> snap4
> Snapshot info of snap3 -
> {code:java}
> # ozone sh snapshot info vol-n1fu0/buck-tin1a snap-ton6m
> {
> "volumeName" : "vol-n1fu0",
> "bucketName" : "buck-tin1a",
> "name" : "snap-ton6m",
> "creationTime" : 1727997314792,
> "snapshotStatus" : "SNAPSHOT_ACTIVE",
> "snapshotId" : "0b731ad8-e256-42c1-9fdc-2a3ae22dedbc",
> "snapshotPath" : "vol-n1fu0/buck-tin1a",
> "checkpointDir" : "-0b731ad8-e256-42c1-9fdc-2a3ae22dedbc",
> "referencedSize" : 362807296,
> "referencedReplicatedSize" : 1088421888,
> "exclusiveSize" : 0,
> "exclusiveReplicatedSize" : 0
> } {code}
> Snapshot info of snap6 -
> {code:java}
> # ozone sh snapshot info vol-n1fu0/buck-tin1a snap-8barh
> {
> "volumeName" : "vol-n1fu0",
> "bucketName" : "buck-tin1a",
> "name" : "snap-8barh",
> "creationTime" : 1727997400069,
> "snapshotStatus" : "SNAPSHOT_ACTIVE",
> "snapshotId" : "ddf4e855-c3fb-4026-8a42-6dfe73bfd858",
> "snapshotPath" : "vol-n1fu0/buck-tin1a",
> "checkpointDir" : "-ddf4e855-c3fb-4026-8a42-6dfe73bfd858",
> "referencedSize" : 362807296,
> "referencedReplicatedSize" : 1088421888,
> "exclusiveSize" : 0,
> "exclusiveReplicatedSize" : 0
> } {code}
> All snapshot contents -
> {code:java}
> # ozone fs -ls -R ofs://ozone1727943432/vol-n1fu0/buck-tin1a/.snapshot
> drwxrwxrwx - hrt_qa hrt_qa 0 2024-10-03 23:14
> ofs://ozone1727943432/vol-n1fu0/buck-tin1a/.snapshot/snap-34qcr
> drwxrwxrwx - hrt_qa hrt_qa 362807296 2024-10-03 23:16
> ofs://ozone1727943432/vol-n1fu0/buck-tin1a/.snapshot/snap-8barh
> -rw-rw-rw- 3 hrt_qa om 181403648 2024-10-03 23:14
> ofs://ozone1727943432/vol-n1fu0/buck-tin1a/.snapshot/snap-8barh/key_1727997247
> -rw-rw-rw- 3 hrt_qa om 181403648 2024-10-03 23:16
> ofs://ozone1727943432/vol-n1fu0/buck-tin1a/.snapshot/snap-8barh/key_1727997378
> drwxrwxrwx - hrt_qa hrt_qa 181403648 2024-10-03 23:14
> ofs://ozone1727943432/vol-n1fu0/buck-tin1a/.snapshot/snap-bz1a9
> -rw-rw-rw- 3 hrt_qa om 181403648 2024-10-03 23:14
> ofs://ozone1727943432/vol-n1fu0/buck-tin1a/.snapshot/snap-bz1a9/key_1727997247
> drwxrwxrwx - hrt_qa hrt_qa 362807296 2024-10-03 23:15
> ofs://ozone1727943432/vol-n1fu0/buck-tin1a/.snapshot/snap-ton6m
> -rw-rw-rw- 3 hrt_qa om 181403648 2024-10-03 23:14
> ofs://ozone1727943432/vol-n1fu0/buck-tin1a/.snapshot/snap-ton6m/key_1727997247
> -rw-rw-rw- 3 hrt_qa om 181403648 2024-10-03 23:15
> ofs://ozone1727943432/vol-n1fu0/buck-tin1a/.snapshot/snap-ton6m/key_1727997298
> drwxrwxrwx - hrt_qa hrt_qa 181403648 2024-10-03 23:15
> ofs://ozone1727943432/vol-n1fu0/buck-tin1a/.snapshot/snap-vsiih
> -rw-rw-rw- 3 hrt_qa om 181403648 2024-10-03 23:14
> ofs://ozone1727943432/vol-n1fu0/buck-tin1a/.snapshot/snap-vsiih/key_1727997247
> drwxrwxrwx - hrt_qa hrt_qa 181403648 2024-10-03 23:16
> ofs://ozone1727943432/vol-n1fu0/buck-tin1a/.snapshot/snap-wk1to
> -rw-rw-rw- 3 hrt_qa om 181403648 2024-10-03 23:14
> ofs://ozone1727943432/vol-n1fu0/buck-tin1a/.snapshot/snap-wk1to/key_1727997247
> {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
