Arafat Khan created HDDS-13854:
----------------------------------
Summary: Add Integration Tests for NSSummar Totals with FS and SH
APIs
Key: HDDS-13854
URL: https://issues.apache.org/jira/browse/HDDS-13854
Project: Apache Ozone
Issue Type: Improvement
Components: Ozone Recon
Reporter: Arafat Khan
Add integration tests to validate that the *NSSummary materialized view*
accurately maintains {{totalFiles}} and {{totalSize}} across all filesystem
operations, using both the *Hadoop FileSystem API* ({{{}ozone fs{}}}) and
*Ozone Shell API* ({{{}ozone sh{}}}).
h3. *Test Objective*
Verify that {{numOfFiles}} and {{sizeOfFiles}} in *NSSummary* stay accurate
through all operations, APIs, and bucket layouts.
h3. *Scope*
* *APIs:* Hadoop FileSystem ({{{}ozone fs{}}}), Ozone Client ({{{}ozone sh{}}})
* *Bucket Layouts:* FSO, Legacy, OBS
h3. *Test Scenarios*
# *Additions:*
** Create nested directories and files.
** Validate total propagation up the hierarchy.
# *Deletions:*
** Delete files or directories.
** Confirm parent and ancestor totals decrement correctly.
# *Updates:*
** Overwrite, rename, or move files.
** Ensure size and count adjustments reflect accurately.
# *Edge Cases:*
** Handle empty directories, deep hierarchies, and mixed operations.
** Verify totals remain consistent.
h3. *Verification Criteria*
After each operation and Recon sync:
* Bucket {{numOfFiles}} matches total files in its hierarchy.
* Bucket {{sizeOfFiles}} equals the cumulative file size.
* Parent directories show correct subtree totals.
* Deletions correctly update ancestor summaries.
h3. *Goal*
Confirm that the materialized totals ({{{}numOfFiles{}}}, {{{}sizeOfFiles{}}})
remain *consistent, accurate, and synchronized* under all conditions and
operations.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
