Re: Failed job restart - flink on yarn

2016-07-05 Thread Jamie Grier
> [hidden email] >> >> >> >> >> >> >> >> >> >> If you reply to this email, your message will be added to the >> discussion >> >> below: >> >> >> >> >> http://apache-flin

Re: Failed job restart - flink on yarn

2016-07-05 Thread vpra...@gmail.com
> >>> Thanks, > >>> Prabhu > >>> > >>> > >>> > >>> -- > >>> View this message in context: > >>> > http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Failed-job-restart-flink-on-yarn

Re: Failed job restart - flink on yarn

2016-07-04 Thread Ufuk Celebi
ailing-list-archive.2336050.n4.nabble.com/Failed-job-restart-flink-on-yarn-tp7764.html >>> Sent from the Apache Flink User Mailing List archive. mailing list >>> archive at Nabble.com. >> >> >> >> >> -- >> >> Jamie Grier >> data Art

Re: Failed job restart - flink on yarn

2016-07-01 Thread vpra...@gmail.com
Hi Jamie, Thanks for the reply. Yeah i looked at save points, i want to start my job only from the last checkpoint, this means I have to keep track of when the checkpoint was taken and the trigger a save point. I am not sure this is the way to go. My state backend is HDFS and I can see that the

Re: Failed job restart - flink on yarn

2016-07-01 Thread Jamie Grier
Hi Prabhu, Have you taken a look at Flink's savepoints feature? This allows you to make snapshots of your job's state on demand and then at any time restart your job from that point: https://ci.apache.org/projects/flink/flink-docs-release-1.0/apis/streaming/savepoints.html Also know that you