Re: Blocking RichFunction.open() and backpressure

2016-12-19 Thread Yury Ruchin
Thanks Fabian, that quite explains what's going on. 2016-12-19 12:19 GMT+03:00 Fabian Hueske : > Hi Yury, > > Flink's operators start processing as soon as they receive data. If an > operator produces more data than its successor task can process, the data > is buffered in

Re: Blocking RichFunction.open() and backpressure

2016-12-19 Thread Fabian Hueske
Hi Yury, Flink's operators start processing as soon as they receive data. If an operator produces more data than its successor task can process, the data is buffered in Flink's network stack, i.e., its network buffers. The backpressure mechanism kicks in when all network buffers are in use and no