Re: Quick question about flink document.

2023-04-09 Thread Hang Ruan
Hi, Dongwoo, I think there is no problem in this part. This part describes snapshotting Operator State, which is checkpointing. The checkpoint will store by the JobManager and use the checkpoint storage. Best, Hang Feng Jin 于2023年4月10日周一 00:32写道: > Hi Dongwoo > > > This can be quite

Re: Quick question about flink document.

2023-04-09 Thread Shammon FY
Hi Dongwoo I think there are two configurations about state, one is state backend and the other is snapshot storage. Flink will create a snapshot for each state when the stateful operator collects all checkpoint barriers. As @Feng mentioned above, users can config different state backend with

Re: Quick question about flink document.

2023-04-09 Thread Feng Jin
Hi Dongwoo This can be quite confusing. Before Flink 1.13, Flink's statebackend was actually a hybrid concept that included three types of statebackends: *MemoryStateBackend*, *FsStateBackend*, and *RocksDBStateBackend*. The default *MemoryStateBackend* uses heap as the backend, and the state

Quick question about flink document.

2023-04-09 Thread Dongwoo Kim
Hi community, I’m new to flink and trying to learn about the concepts of flink to prepare migrating heron application to flink. I have a quick question about this flink document.