[
https://issues.apache.org/jira/browse/FLINK-33819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17796992#comment-17796992
]
Hangxiang Yu commented on FLINK-33819:
--------------------------------------
Linked FLINK-20684 as it has been discussed before.
Linked FLINK-11313 which talks about the LZ4 Compression which should be more
usable than Snappy.
IMO, it should improve performane if we disbale the compression of L0/L1 in
some scenes.
[~mayuehappy] Do you have some test results on it ?
BTW, If we'd like to introduce such a option, it's better to guarantee the
compalibility.
> Support setting CompressType in RocksDBStateBackend
> ---------------------------------------------------
>
> Key: FLINK-33819
> URL: https://issues.apache.org/jira/browse/FLINK-33819
> Project: Flink
> Issue Type: Improvement
> Components: Runtime / State Backends
> Affects Versions: 1.18.0
> Reporter: Yue Ma
> Priority: Major
> Fix For: 1.19.0
>
> Attachments: image-2023-12-14-11-32-32-968.png,
> image-2023-12-14-11-35-22-306.png
>
>
> Currently, RocksDBStateBackend does not support setting the compression
> level, and Snappy is used for compression by default. But we have some
> scenarios where compression will use a lot of CPU resources. Turning off
> compression can significantly reduce CPU overhead. So we may need to support
> a parameter for users to set the CompressType of Rocksdb.
> !image-2023-12-14-11-35-22-306.png!
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
