Paris Carbone created FLINK-5089:
------------------------------------
Summary: Introduce Loop functions and Enforce Nesting on Data
Streams
Key: FLINK-5089
URL: https://issues.apache.org/jira/browse/FLINK-5089
Project: Flink
Issue Type: Improvement
Components: DataStream API
Reporter: Paris Carbone
Assignee: Paris Carbone
The current programming model of stream iterations in the DataStream API is
exposed through low-level dataflow operations for placing arbitrary
feedback-edges. This strategy does not enforce proper nesting and requires
user-defined timeouts to enforce termination. It further impacts correctness,
resulting to incomplete processing or/and inconsistent state when iterations
exist in the topology. There is a need for a new functional, yet compositional
API (i.e. nested loops) for expressing asynchronous DataStream loops to be able
to build easily decentralized progress establishment algorithms such as
distributed termination and parallel structured or fixpoint iterations.
This Jira explains parts of the needs addressed by FLIP-15 on Loops and
Terminations.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
