Hi Aeden, the option that you mentioned should have actually caused your desired behavior. Can you double-check that it's set for the job (you can look at the config in the Flink UI to be 100% sure).
Another option is to simply give all task managers 2 slots. In that way, the scheduler can only evenly distribute. On Wed, Mar 10, 2021 at 7:21 PM Aeden Jameson <aeden.jame...@gmail.com> wrote: > I have a cluster with 18 task managers 4 task slots each running a > job whose source/sink(s) are declared with FlinkSQL using the Kafka > connector. The topic being read has 36 partitions. The problem I'm > observing is that the subtasks for the sources are not evenly > distributed. For example, 1 task manager will have 4 active source > subtasks and other TM's none. Is there a way to force each task > manager to have 2 active source subtasks. I tried using the setting > cluster.evenly-spread-out-slots: true , but that didn't have the > desired effect. > > -- > Thank you, > Aeden >
