Re: Enabling Flink’s checkpointing

2018-11-19 Thread Andrey Zagrebin
Hi Olga,

Not sure where it is stated in the docs to make sure that source/sink 
implements the interface.

From what I see in the source code, if a user function does not implement 
CheckpointedFunction or ListCheckpointed, its operator state will just not be 
snapshotted, but I do not see any problem for enabled checkpoint to snapshot 
what supports it and success for the job.

Best,
Andrey

> On 15 Nov 2018, at 18:20, Olga Luganska  wrote:
> 
> Hello,
> 
> By reading Flink documentation I see that to enable checkpointing we need to:
> 
> 1. Enable checkpointing at the execution environment.
> 
> 2. Make sure that your source/sink implements either CheckpointedFunction or 
> ListCheckpointed interfaces?
> 
> Is #2 a must, and how checkpointing mechanism is affected if your source does 
> not implement mentioned above interfaces?
> 
> (I see example of using RuntimeContext accessing keyed state)
> 
> Please explain.
> Thank you very much,
> Olga
> 
> 
> Sent from my iPhone



Enabling Flink’s checkpointing

2018-11-15 Thread Olga Luganska
Hello,

By reading Flink documentation I see that to enable checkpointing we need to:

1. Enable checkpointing at the execution environment.

2. Make sure that your source/sink implements either CheckpointedFunction or 
ListCheckpointed interfaces?

Is #2 a must, and how checkpointing mechanism is affected if your source does 
not implement mentioned above interfaces?

(I see example of using RuntimeContext accessing keyed state)

Please explain.
Thank you very much,
Olga


Sent from my iPhone