Re: State management and heap usage

Thank you. Michael > On Apr 12, 2018, at 2:45 AM, Gary Yao wrote: > > Hi Michael, > > You can configure the default state backend by setting state.backend in > flink-conf.yaml, or you can configure it per job [1]. The default state > backend > is "jobmanager"

Re: State management and heap usage

Hi Michael, You can configure the default state backend by setting state.backend in flink-conf.yaml, or you can configure it per job [1]. The default state backend is "jobmanager" (MemoryStateBackend), which stores state and checkpoints on the Java heap. RocksDB must be explicitly enabled, e.g.,

State management and heap usage

I am pretty new to flink and have an initial streaming job working both locally and remotely. But, both ways if the data volume is too high it runs out of heap. I am using RichMapFunction to process multiple streams of data. I assumed Flink would manage keeping state in ram when possible,