Hi, Mary
Flink has an alignment mechanism for synchronization. All upstream
taks (for example reduce1) will send a message after the end of a round
to inform all downstream that he has processed all the data. When the
downstream (reduce2) collected all the messages from all his upstream
t
Hi All,
This is more of a general question. How are tasks synchronized in batch
execution? If, for example, we ran an iterative pipeline (map1 -> reduce1 ->
reduce2 -> map2), and the first two operators (map1->reduce1) were chained, how
would reduce2 be notified that map1 -> reduce1 have comple
