From: David Anderson
Sent: Saturday, July 18, 2020 19:34
To: Vijay Bhaskar
Cc: user
Subject: Re: Flink FsStatebackend is giving better performance than RocksDB
You should be able to tune your setup to avoid the OOM problem you have run
into with RocksDB. It will grow to use all of the memory
You should be able to tune your setup to avoid the OOM problem you have run
into with RocksDB. It will grow to use all of the memory available to it,
but shouldn't leak. Perhaps something is misconfigured.
As for performance, with the FSStateBackend you can expect:
* much better throughput and
Hi
While doing scale testing we observed that FSStatebackend is out
performing RocksDB.
When using RocksDB, off heap memory keeps growing over a period of time
and after a day pod got terminated with OOM.
Whereas the same data pattern FSStatebackend is running for days without
any memory spike
