Hi everyone, I would like to start a discussion about adding a new type of scheduler to Flink. The declarative scheduler will first declare the required resources and wait for them before deciding on the actual parallelism of a job. Thereby it can better handle situations where resources cannot be fully fulfilled. Moreover, it will act as a building block for the reactive mode where Flink should scale to the maximum of the currently available resources.
Please find more details in the FLIP wiki document [1]. Looking forward to your feedback. [1] https://cwiki.apache.org/confluence/x/mwtRCg Cheers, Till