Hi sohimankotia,

Have you ever enableExternalizedCheckpoints[1]?

> // enable externalized checkpoints which are retained after job
> cancellation
>
> env.getCheckpointConfig().enableExternalizedCheckpoints(ExternalizedCheckpointCleanup.RETAIN_ON_CANCELLATION);


Best, Hequn

[1]
https://ci.apache.org/projects/flink/flink-docs-release-1.6/dev/stream/state/checkpointing.html#enabling-and-configuring-checkpointing

On Tue, Oct 16, 2018 at 11:47 PM sohimankotia <sohimanko...@gmail.com>
wrote:

> Hi,
>
> I am using following in code :
>
> 1. flink 1.4
> 2. running example on IDE
> 3. Enabled Exactly once semantics
> 4. Window Aggregation
> 5. Checkpoint is enabled at 20 Sec
> 6/ RocksDB as state backend
>
>
> Workflow :
>
> Kafka Source -> map -> keyBy -> Window(60 Sec) -> ApplyFunction ->
> Aggregated Record to Kafka
>
> Issues :
>
> I am having issues with checkpointing . If job reads few records from kafka
> and Window still needs to be evaluated , even then checkpointed is
> triggered
> and getting completed successfully.
> If i stop job after 30 seconds (by this kafka checkpoint is completed) and
> restart my job .. all inflight messages for window are getting lost . Flink
> is not restoring them from state backend.
>
> Attaching code .
>
>
> CheckpointTest1.java
> <
> http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/file/t894/CheckpointTest1.java>
>
>
>
>
> --
> Sent from:
> http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/
>

Reply via email to