Re: Regression for dataStream.rescale method from 1.2.1 to 1.3.2

2017-10-13 Thread Till Rohrmann
Hi Antoine, this looks like a regression to me. I'll investigate how this could happen and let you know once I find something. Cheers, Till On Fri, Oct 13, 2017 at 10:16 AM, Antoine Philippot < antoine.philip...@teads.tv> wrote: > Hi, > > After migrating our project from flink 1.2.1 to flink 1.

Regression for dataStream.rescale method from 1.2.1 to 1.3.2

2017-10-13 Thread Antoine Philippot
Hi, After migrating our project from flink 1.2.1 to flink 1.3.2, we noticed a big performance drop due to a bad vertices balancing between task manager. In our use case, we set the default parallelism to the number of task managers : val stream: DataStream[Array[Byte]] = env.addSource(new Flink