Re: Substasks - Uneven allocation

Hi Pedro, currently, Flink does not allow you to explicitly control the scheduling strategy at such a fine grained level. The idea behind this is to achieve location transparency and to make the scheduling easier. However, there are some tricks you could play depending on the actual job. For exam

Re: Substasks - Uneven allocation

That is only used to split the load across all of the subtasks, which am already doing. It is not related with the allocation. - Best Regards, Pedro Chaves -- Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/

Re: Substasks - Uneven allocation

Hi Pedro, You can try to call either .rebalance() or|.shuffle()| || |before the Async operator. Shuffle might give a better result if you have fewer tasks than parallelism. Best regards, Kien | On 4/18/2018 11:10 PM, PedroMrChaves wrote: Hello, I have a job that has one async operational

Re: Substasks - Uneven allocation

Hi Pedro, That’s interesting, and something we’d like to be able to control as well. I did a little research, and it seems like (with some stunts) there could be a way to achieve this via CoLocationConstraint

Substasks - Uneven allocation

Hello, I have a job that has one async operational node (i.e. implements AsyncFunction). This Operational node will spawn multiple threads that perform heavy tasks (cpu bound). I have a Flink Standalone cluster deployed on two machines of 32 cores and 128 gb of RAM, each machine has one task man