Radeity commented on issue #9337: URL: https://github.com/apache/dolphinscheduler/issues/9337#issuecomment-1356198887
> BTW, I think we may not put `ResourceManager` into master. We need more discussions on this point. Hi, @EricGao888, i think ds should only get involved in executors resource management in standalone mode. BTW, i think we should keep the conception of `Master` and `Worker`, and introduce new conception of `Executor` in charge of actual task execution, like design in Spark. In current design, many types of task directly runs on worker. I think ds' `Master` and `Worker` have to focus on scheduling, only in standalone mode, `Worker` is in charge of computing resource management and launch `Executor`. In other modes like DS on K8S / Yarn, `Master` can directly launch remote `Executor` in external K8S or Yarn cluster which in charge of resource management now. In a word, this could be a big architectural change. Anyway, just a humble suggestion, feel free to correct me, i'm interested in any further discussion! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
