[
https://issues.apache.org/jira/browse/HDDS-13442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tanvi Penumudy updated HDDS-13442:
----------------------------------
Description:
Recon OmTableHandlers currently rely on the full KeyInfo proto for key
metadata. However, most of the fields in OMKeyInfo, such as KeyLocationList,
FileEncryptionInfoProto, OzoneAclInfo, and FileChecksumProto, are not required
and contribute to unnecessary serialization and deserialization overhead.
This inefficiency becomes significant for larger keys or multipart upload (MPU)
keys, where the KeyLocationList can be very large. As a result, this can cause
performance degradation for clients querying this API.
To address this, OMKeyInfo objects should be replaced with a lighter weight
object - ReconBasicOmKeyInfo (based on the KeyInfoProtoLight proto) introduced
in [PR #8699|https://github.com/apache/ozone/pull/8699]. This lightweight
version includes only the necessary fields required for event handling.
was:
Recon OmTableHandlers currently rely on the full KeyInfo proto for key
metadata. However, most of the fields in OMKeyInfo, such as KeyLocationList,
FileEncryptionInfoProto, OzoneAclInfo, and FileChecksumProto, are not required
and contribute to unnecessary serialization and deserialization overhead.
This inefficiency becomes significant for larger keys or multipart upload (MPU)
keys, where the KeyLocationList can be very large. As a result, this can cause
performance degradation for clients querying this API.
To address this, OMKeyInfo objects should be replaced with a lightweight
proto—ReconBasicOmKeyInfo (based on the KeyInfoProtoLight proto) introduced in
[PR #8699|https://github.com/apache/ozone/pull/8699]. This lightweight version
includes only the necessary fields required for event handling.
> Replace OMKeyInfo with light-weight ReconBasicOmKeyInfo under OmTableHandlers
> -----------------------------------------------------------------------------
>
> Key: HDDS-13442
> URL: https://issues.apache.org/jira/browse/HDDS-13442
> Project: Apache Ozone
> Issue Type: Sub-task
> Components: Ozone Recon
> Reporter: Tanvi Penumudy
> Assignee: Tanvi Penumudy
> Priority: Major
>
> Recon OmTableHandlers currently rely on the full KeyInfo proto for key
> metadata. However, most of the fields in OMKeyInfo, such as KeyLocationList,
> FileEncryptionInfoProto, OzoneAclInfo, and FileChecksumProto, are not
> required and contribute to unnecessary serialization and deserialization
> overhead.
> This inefficiency becomes significant for larger keys or multipart upload
> (MPU) keys, where the KeyLocationList can be very large. As a result, this
> can cause performance degradation for clients querying this API.
> To address this, OMKeyInfo objects should be replaced with a lighter weight
> object - ReconBasicOmKeyInfo (based on the KeyInfoProtoLight proto)
> introduced in [PR #8699|https://github.com/apache/ozone/pull/8699]. This
> lightweight version includes only the necessary fields required for event
> handling.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
