Re: flink job restarts when flink cluster restarts?

2018-11-12 Thread Timo Walther
Hi, by default all the metadata is lost when shutting down the JobManager in a non high available setup. Flink uses Zookeeper together with a distributed filesystem to store the required metadata [1] in a persistent and distributed manner. A single node setup is rather uncommon, but you can

Re: flink job restarts when flink cluster restarts?

2018-11-08 Thread Chang Liu
Thanks! If I have a cluster more than one node (standalone or YRAN), can I stop and start any single node among them and keep the job running? Best regards/祝好, Chang Liu 刘畅 > On 7 Nov 2018, at 16:17, 秦超峰 <18637156...@163.com> wrote: > > the second > > > > > 秦超峰 >

Re: flink job restarts when flink cluster restarts?

2018-11-08 Thread Chang Liu
Or to say, how can I keep the jobs for system patching, server restart, etc. Is it related to Standalone vs YARN? Or is it related to whether to use Zookeeper? Many thanks! Best regards/祝好, Chang Liu 刘畅 > On 8 Nov 2018, at 13:38, Chang Liu wrote: > > Thanks! > > If I have a cluster more

flink job restarts when flink cluster restarts?

2018-11-07 Thread Chang Liu
Hi, I have a question regarding whether the current running job will restart if I stop and start the flink cluster? 1. Let’s say I am just having a Standalone one node cluster. 2. I have several Flink jobs already running on the cluster. 3. If I do a bin/cluster-stop.sh and then do a