Usamah Jassat created FLINK-28539:
-------------------------------------
Summary: Enable CompactionDynamicLevelBytes in FLASH_SSD_OPTIMIZED
Key: FLINK-28539
URL: https://issues.apache.org/jira/browse/FLINK-28539
Project: Flink
Issue Type: Improvement
Components: Runtime / State Backends
Reporter: Usamah Jassat
Investigating the RocksDB predefined options I see that
`setLevelCompactionDynamicLevelBytes` is set for SPINNING_DISK options but not
FLASH_SSD_OPTIMIZED.
>From my research it looks like this change would improve the Space
>Amplification of RocksDB [1] (which can also lead to a trade-off from
>read/write amplification [2]). It makes sense to me that this feature should
>be enabled for SSD's as they tend to have less space compared to their HDD
>counterparts.
There is also an argument to be made to also disable it for SPINNING_DISK
options as it could give increased read/write performance [2]
[1] [http://rocksdb.org/blog/2015/07/23/dynamic-level.html]
[2]
[https://github.com/EighteenZi/rocksdb_wiki/blob/master/RocksDB-Tuning-Guide.md#amplification-factors]
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
