KarmaGYZ opened a new pull request #14647:
URL: https://github.com/apache/flink/pull/14647
## What is the purpose of the change
Introduce SlotManager plugin for fine-grained resource management.
- Request slot from TaskExecutor with the actual resource profiles.
- Use ResourceTracker to bookkeep the resource requirements
- Introduce TaskExecutorTracker, which bookkeep the total / available
resource and slot assignment for registered task executor.
- Bookkeep task manager total and available resources.
- Bookkeep slot allocations and assignments.
- Intorduce PendingTaskManager.
- Map registered task executors to matching PendingTaskManager.
## Brief change log
- af078b2 : hotfix
- fcf8b2e : Add feature toggle for fine-grained resource management
- 70dd92e ... ec1a427 : Code refactor and introduce utility method
- ebc0a6e : Introduce TaskExecutorMatchingStrategy and its implementations
for fine-grained resource management.
- e7be627 : Introduce TaskExecutorTracker to track TaskExecutor's resource
and slot status
- e178fe1 : Introduce the FineGrainedSlotManager
- 1c60554 : setup Azure build for FineGrainedSlotManager
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
