Hi Devs, I'm opening this thread to discuss FLIP-362: Support minimum resource limitation. The design doc can be found at: FLIP-362: Support minimum resource limitation <https://cwiki.apache.org/confluence/display/FLINK/FLIP-362%3A+Support+minimum+resource+limitation>
Currently, the Flink cluster only requests Task Managers (TMs) when there is a resource requirement, and idle TMs are released after a certain period of time. However, in certain scenarios, such as running short lived-jobs in session cluster and scheduling batch jobs stage by stage, we need to improve the efficiency of job execution by maintaining a certain number of available workers in the cluster all the time. After discussed with Yangze, we introduced this new feature. The new added public options and proposed changes are described in this FLIP. Looking forward to your feedback, thanks. Best regards, Xiangyu