Hey all, Now that many of you have already scanned the document (judging from the views) maybe it is time to give back some feedback! Did you like it? Would you suggest an improvement?
I would suggest not to leave this in the void. It has to do with important properties that the system promises to provide. Me and Fouad will do our best to answer your questions and discuss this further. cheers Paris On 21 Oct 2016, at 08:54, Paris Carbone <par...@kth.se<mailto:par...@kth.se>> wrote: Hello everyone, Loops in Apache Flink have a good potential to become a much more powerful thing in future version of Apache Flink. There is generally high demand to make them usable and first of all production-ready for upcoming releases. As a first commitment we would like to propose FLIP-13 for consistent processing with Loops. We are also working on scoped loops for Q1 2017 which we can share if there is enough interest. For now, that is an improvement proposal that solves two pending major issues: 1) The (not so trivial) problem of correct termination of jobs with iterations 2) The applicability of the checkpointing algorithm to iterative dataflow graphs. We would really appreciate it if you go through the linked draft (motivation and proposed changes) for FLIP-13 and point out comments, preferably publicly in this devlist discussion before we go ahead and update the wiki. https://docs.google.com/document/d/1M6ERj-TzlykMLHzPSwW5L9b0BhDbtoYucmByBjRBISs/edit?usp=sharing cheers Paris and Fouad