zentol opened a new pull request, #22883:
URL: https://github.com/apache/flink/pull/22883
based on #22795 for ease of testing.
The Adaptive Scheduler now supports a _minimum_ parallelism per vertex.
* a job is only run if the minimum required slots of all vertices is
fulfilled
* if the minimum parallelism is being raised above the currently available
number of slots (== implicitly above the current parallelism) the scheduler
immediately cancels the job and tries to rescale it. It will either restart the
job if it could acquire the additionally required slots, or fail the job once
the stabilization timeout kicked in.
* We could consider adding some timeout here for the cancellation, to give
us some time to acquire more slots.
* if the minimum parallelism is lowered, or raised below the current
parallelism, the job just keeps running.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
