huagetai opened a new issue #9337:
URL: https://github.com/apache/dolphinscheduler/issues/9337


   ### Search before asking
   
   - [X] I had searched in the 
[issues](https://github.com/apache/dolphinscheduler/issues?q=is%3Aissue) and 
found no similar feature requirement.
   
   
   ### Description
   
   When deployed on cluster managers such as k8s and yarn, dolphinscheduler 
supports worker elastic scaling
   The initial idea is as follows:
   ![DolphinSchedule 
001](https://user-images.githubusercontent.com/1137341/161391656-797b5b40-568f-41ca-8043-b1899044d49e.jpeg)
   
   1. Add ResourceManager to the master server.
   2. ResourceManager is responsible for the management and application of 
worker resources.
   3. ResourceManager perceives the online and offline of worker nodes through 
the register.
   4. The ResourceManager goes to the cluster manager to apply for resources 
according to the per workflow. The resources are released at the end of the 
workflow.
   
   ### Use case
   
    worker elastic scaling
   
   ### Related issues
   
   _No response_
   
   ### Are you willing to submit a PR?
   
   - [X] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of 
Conduct](https://www.apache.org/foundation/policies/conduct)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


Reply via email to