Re: Flink rolling upgrade support

2017-07-19 Thread Moiz Jinia
other thread, right ? http://search-hadoop.com/m/Flink/VkLeQ0dXIf1SkHpY?subj=Re+Does+job+restart+resume+from+last+known+internal+checkpoint+ > On Wed, Jul 19, 2017 at 9:02 AM, Moiz Jinia <moiz.ji...@gmail.com> wrote: > Yup! Thanks. > > Moiz > > — > sent from phon

Re: Flink rolling upgrade support

2017-07-19 Thread Moiz Jinia
Yup! Thanks. Moiz — sent from phone On 19-Jul-2017, at 9:21 PM, Aljoscha Krettek [via Apache Flink User Mailing List archive.] <ml+s2336050n14337...@n4.nabble.com> wrote: This was now answered in your other Thread, right? Best, Aljoscha >> On 18. Jul 2017, at 11:37, Moiz Ji

Does FlinkKafkaConsumer010 care about consumer group?

2017-07-19 Thread Moiz Jinia
Below is a plan for downtime-free upgrade of a Flink job. The downstream consumer of the Flink job is duplicate proof. Scenario 1 - 1. Start Flink job A with consumer group G1 (12 slot job) 2. While job A is running, take a savepoint AS. 3. Start newer version of Flink job A' from savepoint AS

Re: Flink rolling upgrade support

2017-07-18 Thread Moiz Jinia
Aljoscha Krettek wrote > Hi, > zero-downtime updates are currently not supported. What is supported in > Flink right now is a savepoint-shutdown-restore cycle. With this, you > first > draw a savepoint (which is essentially a checkpoint with some meta data), > then you cancel your job, then you do

Re: Long running time based Patterns

2017-05-04 Thread Moiz Jinia
It'll definitely have a where clause. Just forgot to include it in the example. Just meant to focus on the within clause. Am on 1.3 - expect it'll be fixed by the time stable is out? Thanks! Moiz — sent from phone On 04-May-2017, at 8:12 PM, Kostas Kloudas