There are no built in constructs which allow for a conditional iterative execution. This issue (https://issues.apache.org/jira/browse/BEAM-106) tracks the feature request. Today, if you know some upperbound on how many times your pipeline needs to loop then you can manually unroll the loop. Alternatively you can create a cycle by reading and writing to the same unbounded source/sink (e.g. read and write to the same Kafka topic).
On Mon, Jan 9, 2017 at 7:34 AM, Tao Meng <[email protected]> wrote: > Hi all, > I have a question about iterative streaming job. Can beam create a > iterative streaming job? For example, https://github.com/ > apache/flink/blob/master/flink-examples/flink-examples- > streaming/src/main/java/org/apache/flink/streaming/examples/iteration/ > IterateExample.java > > Thanks >
