Thanks for working on improving cancel-with-savepoint Kostas. Distinguishing the termination modes would be a big step forward, IMO.
Btw. there is already another FLIP-33 on the way. This one should be FLIP-34. Cheers, Fabian Am Di., 12. Feb. 2019 um 18:49 Uhr schrieb Stephan Ewen <se...@apache.org>: > Thank you for starting this feature discussion. > This is a feature that has been requested various times, great to see it > happening. > > +1 for this FLIP > > On Tue, Feb 12, 2019 at 5:28 PM Kostas Kloudas <k.klou...@ververica.com> > wrote: > > > Hi everyone, > > > > A commonly used functionality offered by Flink is the > > "cancel-with-savepoint" operation. When applied to the current > exactly-once > > sinks, the current implementation of the feature can be problematic, as > it > > does not guarantee that side-effects will be committed by Flink to the > 3rd > > party storage system. > > > > This discussion targets fixing this issue and proposes the addition of > two > > termination modes, namely: > > 1) SUSPEND, for temporarily stopping the job, e.g. for Flink version > > upgrading in your cluster > > 2) TERMINATE, for terminal shut down which ends the stream and sends > > MAX_WATERMARK time, and flushes any state associated with (event time) > > timers > > > > A google doc with the FLIP proposal can be found here: > > > > > https://docs.google.com/document/d/1EZf6pJMvqh_HeBCaUOnhLUr9JmkhfPgn6Mre_z6tgp8/edit?usp=sharing > > > > And the page for the FLIP is here: > > > https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=103090212 > > > > The implementation sketch is far from complete, but it is worth having a > > discussion on the semantics as soon as possible. The implementation > section > > is going to be updated soon. > > > > Looking forward to the discussion, > > Kostas > > > > -- > > > > Kostas Kloudas | Software Engineer > > > > > > <https://www.ververica.com/> > > > > Follow us @VervericaData > > > > -- > > > > Join Flink Forward <https://flink-forward.org/> - The Apache Flink > > Conference > > > > Stream Processing | Event Driven | Real Time > > > > -- > > > > Data Artisans GmbH | Invalidenstrasse 115, 10115 Berlin, Germany > > > > -- > > Data Artisans GmbH > > Registered at Amtsgericht Charlottenburg: HRB 158244 B > > Managing Directors: Dr. Kostas Tzoumas, Dr. Stephan Ewen > > >
