Hi Jun Qin,
Do you have any example OptionsFactory for Bloom Filter.
I did experiment and change Options from FLASH_SSD_OPTIMIZED to
SPINNING_DISK_OPTIMIZED_HIGH_MEM.
This gives me 2x better performance on NVME disk.
I think the reason is that I'm doing a lot of reads and
un Tang
>
> From: Till Rohrmann
> Sent: Monday, February 8, 2021 17:06
> To: dev
> Subject: Re: Activate bloom filter in RocksDB State Backend via Flink
> configuration
>
> Hi Jun,
>
> Making things easier
Jun Qin created FLINK-21336:
---
Summary: Activate bloom filter in RocksDB State Backend via Flink
configuration
Key: FLINK-21336
URL: https://issues.apache.org/jira/browse/FLINK-21336
Project: Flink
Tang
From: Till Rohrmann
Sent: Monday, February 8, 2021 17:06
To: dev
Subject: Re: Activate bloom filter in RocksDB State Backend via Flink
configuration
Hi Jun,
Making things easier to use and configure is a good idea. Hence, +1 for
this proposal. Maybe create a JIRA ti
Hi Jun,
Making things easier to use and configure is a good idea. Hence, +1 for
this proposal. Maybe create a JIRA ticket for it.
For the concrete default values it would be nice to hear the opinion of a
RocksDB expert.
Cheers,
Till
On Sun, Feb 7, 2021 at 7:23 PM Jun Qin wrote:
> Hi,
>
>
Hi,
Activating bloom filter in the RocksDB state backend improves read performance.
Currently activating bloom filter can only be done by implementing a custom
ConfigurableRocksDBOptionsFactory. I think we should provide an option to
activate bloom filter via Flink configuration. What do you
