Re: Externalized checkpoints and metadata

2018-04-26 Thread 周思华
10%3A+Unify+Checkpoints+and+Savepoints ? Thank you, Juan G. From: hao gao Date: Wednesday, 25 April 2018 at 20:25 To: Juan Gentile Cc: "user@flink.apache.org" , Oleksandr Nitavskyi Subject: Re: Externalized checkpoints and metadata Hi Juan, We modified the flink code

Re: Externalized checkpoints and metadata

2018-04-26 Thread Juan Gentile
at 20:25 To: Juan Gentile Cc: "user@flink.apache.org" , Oleksandr Nitavskyi Subject: Re: Externalized checkpoints and metadata Hi Juan, We modified the flink code a little bit to change the flink checkpoint structure so we can easily identify which is which you can read my note or th

Re: Externalized checkpoints and metadata

2018-04-25 Thread hao gao
Hi Juan, We modified the flink code a little bit to change the flink checkpoint structure so we can easily identify which is which you can read my note or the PR https://medium.com/hadoop-noob/flink-externalized-checkpoint-eb86e693cfed https://github.com/BranchMetrics/flink/pull/6/files Hope it he

Externalized checkpoints and metadata

2018-04-25 Thread Juan Gentile
Hello, We are trying to use externalized checkpoints, using RocksDB on Hadoop hdfs. We would like to know what is the proper way to resume from a saved checkpoint as we are currently running many jobs in the same flink cluster. The problem is that when we want to restart the jobs and pass the me