Hi, Dongwoo,
I think there is no problem in this part. This part describes snapshotting
Operator State, which is checkpointing. The checkpoint will store by the
JobManager and use the checkpoint storage.
Best,
Hang
Feng Jin 于2023年4月10日周一 00:32写道：
> Hi Dongwoo
>
>
> This can be quite confusing.
Hi Dongwoo
I think there are two configurations about state, one is state backend and
the other is snapshot storage. Flink will create a snapshot for each state
when the stateful operator collects all checkpoint barriers.
As @Feng mentioned above, users can config different state backend with
opt
Hi Dongwoo
This can be quite confusing.
Before Flink 1.13, Flink's statebackend was actually a hybrid concept that
included three types of statebackends:
*MemoryStateBackend*, *FsStateBackend*, and *RocksDBStateBackend*.
The default *MemoryStateBackend* uses heap as the backend, and the state is
Thx for the quick answer
Get Outlook for iOS<https://aka.ms/o0ukef>
From: Chesnay Schepler
Sent: Thursday, June 22, 2017 12:13:23 PM
To: user@flink.apache.org
Subject: Re: Quick Question...
Hello,
in the DataSet API you can do this when specifyin
Hello,
in the DataSet API you can do this when specifying your transformations,
something
along the lines of dataset.map(..).withConfiguration.
In the DataStream API you cannot set the Configuration at all.
Note that in both APIs you can also just pass the Configuration into the
constructor
The only thing you need to be aware of (in the batch API) is that you
cannot simply gather elements in a list any more.
The following does not work when enabling object reuse:
class MyReducer implements GroupReduceFunction {
public void reduceGroup(Iterable values, Collector out) {
Yes, you're right Arnaud.
Cheers,
Till
On Tue, Feb 9, 2016 at 10:42 AM, LINZ, Arnaud
wrote:
> Hi,
>
>
>
> I just want to be sure : when I set enableObjectReuse, I don’t need to
> create copies of objects that I get as input and return as output but which
> I don’t keep inside my user function ?
