Re: Flink streaming job with iterations gets stuck waiting for network buffers

2017-04-03 Thread Gábor Hermann
Hi Andrey, As Paris has explained it, this is a known issue and there are ongoing efforts to solve it. I can suggest a workaround: limit the amount of messages sent into the iteration manually. You can do this with a e.g. a Map operator that limits records per seconds and simply sends what

Re: Flink streaming job with iterations gets stuck waiting for network buffers

2017-04-03 Thread Paris Carbone
Hi Andrey, If I am not mistaken this sounds like a known deadlock case and can be caused by the combination of Flink's backpressure mechanism with iterations (more likely when there is heavy feedback load). Keep in mind that, currently, iterations are (perhaps the only) not stable feature to