Re: Shuffling between map and keyBy operator

2017-09-06 Thread Kurt Young
Hi Marchant, I'm afraid that the serde cost still exists even if both operators run in same TaskManager. Best, Kurt On Tue, Sep 5, 2017 at 9:26 PM, Marchant, Hayden wrote: > I have a streaming application that has a keyBy operator followed by an > operator working on

Shuffling between map and keyBy operator

2017-09-05 Thread Marchant, Hayden
I have a streaming application that has a keyBy operator followed by an operator working on the keyed values (a custom sum operator). If the map operator and aggregate operator are running on same Task Manager , will Flink always serialize and deserialize the tuples, or is there an optimization