Hi Josson,
Thanks for the details. Sorry, I overlooked, you indeed mentioned the file
backend.
Looking into Flink memory model [1], I do not notice any problems related to
the types of memory consumption we model in Flink.
Direct memory consumption by network stack corresponds to your configure
Hi Andrey,
To clarify the above email. I am using Heap Based State and not Rocks DB.
Thanks,
Josson
On Sat, May 23, 2020, 17:37 Josson Paul wrote:
> Hi Andrey,
> We don't use Rocks DB. As I said in the original email I am using File
> Based. Even though our cluster is on Kubernetes out Flin
Hi Andrey,
We don't use Rocks DB. As I said in the original email I am using File
Based. Even though our cluster is on Kubernetes out Flink cluster is
Flink's stand alone resource manager. We have not yet integrated our Flink
with Kubernetes.
Thanks,
Josson
On Fri, May 22, 2020 at 3:37 AM Andre
Hi Josson,
Do you use state backend? is it RocksDB?
Best,
Andrey
On Fri, May 22, 2020 at 12:58 PM Fabian Hueske wrote:
> Hi Josson,
>
> I don't have much experience setting memory bounds in Kubernetes myself,
> but my colleague Andrey (in CC) reworked Flink's memory configuration for
> the las
Hi Josson,
I don't have much experience setting memory bounds in Kubernetes myself,
but my colleague Andrey (in CC) reworked Flink's memory configuration for
the last release to ease the configuration in container envs.
He might be able to help.
Best, Fabian
Am Do., 21. Mai 2020 um 18:43 Uhr sch
