priyeshkaratha opened a new pull request, #9325:
URL: https://github.com/apache/ozone/pull/9325
## What changes were proposed in this pull request?
* This pull request proposes to enhance Ozone's storage visibility by
introducing a new metric: the total bytes consumed by blocks that are pending
deletion. Previously, the system only tracked the *count* of blocks awaiting
deletion, which provided an incomplete picture of the actual disk space that
will eventually be reclaimed. This change aims to provide a more accurate and
comprehensive understanding of the storage that is in the process of being
freed up.
* The core idea involves:
* **Measuring Deleted Data Size:** Instead of just counting deleted
items, the system will now also measure their total size in bytes.
* **Integrating into Existing Systems:** This new size measurement will
be built into the current data deletion service and container data structures.
* **Calculating Size During Deletion:** Mechanisms will be implemented
to calculate the byte size of blocks as they are marked for deletion, ensuring
this information is accurately captured.
* **Saving and Accessing Data:** The total size of deleted data will be
persisted with other container metadata and made available for reporting and
internal operations.
* **Summarizing for Storage:** The system will aggregate the deleted
data sizes for all containers on a storage volume to show how much space can be
reclaimed at the volume level.
* **Improving Reports:** This new byte-based metric will be integrated
into existing monitoring and reporting tools to give a clearer view of storage
that's waiting to be freed up.
## What is the link to the Apache JIRA
https://issues.apache.org/jira/browse/HDDS-13467
## How was this patch tested?
This patch was tested with unit tests. Existing tests for the block deletion
service, key-value container data, schema backward compatibility, container
deletion choosing policy, and delete blocks command handler were updated.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
