Re: [DISCUSS] FLIP-33: Terminate/Suspend Job with Savepoint

2019-03-12 Thread Kostas Kloudas
ill be > >>> available for it. > >>> > >>> For the later "stop" is the appropriate term, and it means that a job > >>> should process no messages after the checkpoints barrier and that it > >> should > >>> ensure that exactly-once sinks complete

Re: [DISCUSS] FLIP-33: Terminate/Suspend Job with Savepoint

2019-03-12 Thread Aljoscha Krettek
> should >>> ensure that exactly-once sinks complete their two-phase commits >>> successfully. If a savepoint was requested, one should be created. >>> >>> So in my mind there are two commands, cancel and stop, with appropriate >>> semantics. Emitting MA

Re: [DISCUSS] FLIP-33: Terminate/Suspend Job with Savepoint

2019-03-07 Thread Kostas Kloudas
gt; > stop is merely an optional behavior, like creation of a savepoint. But > if > > a specific command for it is desired, then "drain" seems appropriate. > > > > On Tue, Feb 12, 2019 at 9:50 AM Stephan Ewen wrote: > > > > > Hi Elias! > > >

Re: [DISCUSS] FLIP-33: Terminate/Suspend Job with Savepoint

2019-03-06 Thread Ufuk Celebi
s appropriate. > > On Tue, Feb 12, 2019 at 9:50 AM Stephan Ewen wrote: > > > Hi Elias! > > > > I remember you brought this missing feature up in the past. Do you think > > the proposed enhancement would work for your use case? > > > > Best, > > S

Re: [DISCUSS] FLIP-33: Terminate/Suspend Job with Savepoint

2019-03-05 Thread Elias Levy
member you brought this missing feature up in the past. Do you think > the proposed enhancement would work for your use case? > > Best, > Stephan > > -- Forwarded message - > From: Kostas Kloudas > Date: Tue, Feb 12, 2019 at 5:28 PM > Subject: [DISC

Re: [DISCUSS] FLIP-33: Terminate/Suspend Job with Savepoint

2019-02-12 Thread Biao Liu
Thanks for bringing us this discussion. I like the idea. It's really useful in production scenario. +1 for the proposal. jincheng sun 于2019年2月13日周三 上午9:35写道: > Thank you for starting the discussion about cancel-with-savepoint Kostas. > > +1 for the FLIP. > > Cheers, > Jincheng > > Fabian

Re: [DISCUSS] FLIP-33: Terminate/Suspend Job with Savepoint

2019-02-12 Thread Guowei Ma
thanks for starting this discussion. It is a very cool feature. +1 for the FLIP Best Guowei jincheng sun 于2019年2月13日周三 上午9:35写道: > Thank you for starting the discussion about cancel-with-savepoint Kostas. > > +1 for the FLIP. > > Cheers, > Jincheng > > Fabian Hueske 于2019年2月13日周三 上午4:31写道: >

Re: [DISCUSS] FLIP-33: Terminate/Suspend Job with Savepoint

2019-02-12 Thread jincheng sun
Thank you for starting the discussion about cancel-with-savepoint Kostas. +1 for the FLIP. Cheers, Jincheng Fabian Hueske 于2019年2月13日周三 上午4:31写道: > Thanks for working on improving cancel-with-savepoint Kostas. > Distinguishing the termination modes would be a big step forward, IMO. > > Btw.

Re: [DISCUSS] FLIP-33: Terminate/Suspend Job with Savepoint

2019-02-12 Thread Fabian Hueske
Thanks for working on improving cancel-with-savepoint Kostas. Distinguishing the termination modes would be a big step forward, IMO. Btw. there is already another FLIP-33 on the way. This one should be FLIP-34. Cheers, Fabian Am Di., 12. Feb. 2019 um 18:49 Uhr schrieb Stephan Ewen : > Thank

Re: [DISCUSS] FLIP-33: Terminate/Suspend Job with Savepoint

2019-02-12 Thread Stephan Ewen
Thank you for starting this feature discussion. This is a feature that has been requested various times, great to see it happening. +1 for this FLIP On Tue, Feb 12, 2019 at 5:28 PM Kostas Kloudas wrote: > Hi everyone, > > A commonly used functionality offered by Flink is the >

[DISCUSS] FLIP-33: Terminate/Suspend Job with Savepoint

2019-02-12 Thread Kostas Kloudas
Hi everyone, A commonly used functionality offered by Flink is the "cancel-with-savepoint" operation. When applied to the current exactly-once sinks, the current implementation of the feature can be problematic, as it does not guarantee that side-effects will be committed by Flink to the 3rd