RE: Two operators consuming from same stream

2018-01-26 Thread Newport, Billy
consuming from same stream Hi group, We have the following graph below, on which we added metrics for latency calculation. We have two streams which are consumed by two operators: * ordersStream and pricesStream - they are both consumed by two operators: CoMapperA and CoMapperB, each using

RE: Two operators consuming from same stream

2018-01-04 Thread Sofer, Tovi
d”,“ orderId”) .flatMap(mapperB); From: Timo Walther [mailto:twal...@apache.org] Sent: יום ד 03 ינואר 2018 11:02 To: user@flink.apache.org Subject: Re: Two operators consuming from same stream Hi Tovi, I think your code without duplication performs two separate shuffle operations whereas the ot

Re: Two operators consuming from same stream

2018-01-03 Thread Timo Walther
Hi Tovi, I think your code without duplication performs two separate shuffle operations whereas the other code only performs one shuffle. Further latency impacts might be due to the overhead involved in maintaining the partitioning for a keyed stream/key groups and switching key contexts in

Two operators consuming from same stream

2018-01-01 Thread Sofer, Tovi
Hi group, We have the following graph below, on which we added metrics for latency calculation. We have two streams which are consumed by two operators: * ordersStream and pricesStream - they are both consumed by two operators: CoMapperA and CoMapperB, each using connect. Initially