[
https://issues.apache.org/jira/browse/HDDS-7350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17633395#comment-17633395
]
Stephen O'Donnell commented on HDDS-7350:
-----------------------------------------
This area needs more thought before committing to an implementation.
One different approach is:
write a chunksize of data (or an EC stripe size) -> compress chunk -> encrypt
chunk -> write to disk some data less than chunk size.
This would certainly require more work than the suggested implementation here,
but it could be made to be seekable and is probably more flexible in general.
The suggested approach isn't much different to simply gzipping the data before
it is written to the Ozone client. From what I have read about ZFS, most
recommend to just enable transparent compression and forget about it - the
overhead is small and the gain is good for many files. With the suggestion
here, we cannot do that, as it will break the ability to seek for any
compressed data, so we have to enable it selectively in a special bucket or key
by key. It is not something an admin can just set and forget for all buckets.
> Ozone Transparent Data Compression Support
> ------------------------------------------
>
> Key: HDDS-7350
> URL: https://issues.apache.org/jira/browse/HDDS-7350
> Project: Apache Ozone
> Issue Type: New Feature
> Reporter: Kirill Sizov
> Assignee: Kirill Sizov
> Priority: Major
> Attachments: compression_ozone - 2022.10.1.pdf,
> compression_ozone-2022.10.2.pdf, compression_ozone-2022.11.1.pdf,
> compression_ozone-2022.11.2.pdf
>
>
> Currently Ozone stores uncompressed data, which in case of text or a similar
> format may benefit from being compressed. This may save significant amount of
> space and hence the money.
> See the attached document for the design.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
