[
https://issues.apache.org/jira/browse/HDDS-13854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arafat Khan updated HDDS-13854:
-------------------------------
Description:
Add integration tests to validate that the *NSSummary materialized view*
accurately maintains {{totalFiles}} and {{totalSize}} across all filesystem
operations, using both the *Hadoop FileSystem API* ({{{}ozone fs{}}}) and
*Ozone Shell API* ({{{}ozone sh{}}}).
----
h3. *Test Objective*
Verify that {{numOfFiles}} and {{sizeOfFiles}} in *NSSummary* stay accurate
through all operations, APIs, and bucket layouts.
----
h3. *Scope*
* *APIs:* Hadoop FileSystem ({{{}ozone fs{}}}), Ozone Client ({{{}ozone sh{}}})
* *Bucket Layouts:* FSO, Legacy, OBS
----
h3. *Test Scenarios*
# *Additions:*
** Create nested directories and files.
** Validate total propagation up the hierarchy.
# *Deletions:*
** Delete files or directories.
** Confirm parent and ancestor totals decrement correctly.
# *Updates:*
** Overwrite, rename, or move files.
** Ensure size and count adjustments reflect accurately.
# *Edge Cases:*
** Handle empty directories, deep hierarchies, and mixed operations.
** Verify totals remain consistent.
----
h3. *Verification Criteria*
After each operation and Recon sync:
* Bucket {{numOfFiles}} matches total files in its hierarchy.
* Bucket {{sizeOfFiles}} equals the cumulative file size.
* Parent directories show correct subtree totals.
* Deletions correctly update ancestor summaries.
----
h3. *Goal*
Confirm that the materialized totals ({{{}numOfFiles{}}}, {{{}sizeOfFiles{}}})
remain *consistent, accurate, and synchronized* under all conditions and
operations.
was:
Add integration tests to validate that the *NSSummary materialized view*
accurately maintains {{totalFiles}} and {{totalSize}} across all filesystem
operations, using both the *Hadoop FileSystem API* ({{{}ozone fs{}}}) and
*Ozone Shell API* ({{{}ozone sh{}}}).
h3. *Test Objective*
Verify that {{numOfFiles}} and {{sizeOfFiles}} in *NSSummary* stay accurate
through all operations, APIs, and bucket layouts.
h3. *Scope*
* *APIs:* Hadoop FileSystem ({{{}ozone fs{}}}), Ozone Client ({{{}ozone sh{}}})
* *Bucket Layouts:* FSO, Legacy, OBS
h3. *Test Scenarios*
# *Additions:*
** Create nested directories and files.
** Validate total propagation up the hierarchy.
# *Deletions:*
** Delete files or directories.
** Confirm parent and ancestor totals decrement correctly.
# *Updates:*
** Overwrite, rename, or move files.
** Ensure size and count adjustments reflect accurately.
# *Edge Cases:*
** Handle empty directories, deep hierarchies, and mixed operations.
** Verify totals remain consistent.
h3. *Verification Criteria*
After each operation and Recon sync:
* Bucket {{numOfFiles}} matches total files in its hierarchy.
* Bucket {{sizeOfFiles}} equals the cumulative file size.
* Parent directories show correct subtree totals.
* Deletions correctly update ancestor summaries.
h3. *Goal*
Confirm that the materialized totals ({{{}numOfFiles{}}}, {{{}sizeOfFiles{}}})
remain *consistent, accurate, and synchronized* under all conditions and
operations.
> Add Integration Tests for NSSummar Totals with FS and SH APIs
> -------------------------------------------------------------
>
> Key: HDDS-13854
> URL: https://issues.apache.org/jira/browse/HDDS-13854
> Project: Apache Ozone
> Issue Type: Improvement
> Components: Ozone Recon
> Reporter: Arafat Khan
> Priority: Major
>
> Add integration tests to validate that the *NSSummary materialized view*
> accurately maintains {{totalFiles}} and {{totalSize}} across all filesystem
> operations, using both the *Hadoop FileSystem API* ({{{}ozone fs{}}}) and
> *Ozone Shell API* ({{{}ozone sh{}}}).
> ----
> h3. *Test Objective*
> Verify that {{numOfFiles}} and {{sizeOfFiles}} in *NSSummary* stay accurate
> through all operations, APIs, and bucket layouts.
> ----
> h3. *Scope*
> * *APIs:* Hadoop FileSystem ({{{}ozone fs{}}}), Ozone Client ({{{}ozone
> sh{}}})
> * *Bucket Layouts:* FSO, Legacy, OBS
> ----
> h3. *Test Scenarios*
> # *Additions:*
> ** Create nested directories and files.
> ** Validate total propagation up the hierarchy.
> # *Deletions:*
> ** Delete files or directories.
> ** Confirm parent and ancestor totals decrement correctly.
> # *Updates:*
> ** Overwrite, rename, or move files.
> ** Ensure size and count adjustments reflect accurately.
> # *Edge Cases:*
> ** Handle empty directories, deep hierarchies, and mixed operations.
> ** Verify totals remain consistent.
> ----
> h3. *Verification Criteria*
> After each operation and Recon sync:
> * Bucket {{numOfFiles}} matches total files in its hierarchy.
> * Bucket {{sizeOfFiles}} equals the cumulative file size.
> * Parent directories show correct subtree totals.
> * Deletions correctly update ancestor summaries.
> ----
> h3. *Goal*
> Confirm that the materialized totals ({{{}numOfFiles{}}},
> {{{}sizeOfFiles{}}}) remain *consistent, accurate, and synchronized* under
> all conditions and operations.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
