HomminLee opened a new issue, #12196: URL: https://github.com/apache/dolphinscheduler/issues/12196
### Search before asking - [X] I had searched in the [issues](https://github.com/apache/dolphinscheduler/issues?q=is%3Aissue) and found no similar issues. ### What happened If too many tasks are started at once, and any one of task consume too much memory, Worker will crash. Worker will report maxCpuloadAvg and reservedMemory to Master though heartbeat. Master will check Worker status when dispatch task, if Worker has not enough memory, Master will put task back to taskPriorityQueue. But heartbeat has 10 seconds interval. Once the Worker status change to available, Master will dispatch all task in queue to Worker. Then Worker will crash. ### What you expected to happen Worker also check loadAverage and reservedMemory before run task. ### How to reproduce Set worker.reserved.memory = 1.5 Create a workflow contains several task, every task consume a lot memory and run a long time, eg: 1G memory and 200 secons. Schedule run workflow with a few seconds. ### Anything else _No response_ ### Version 3.0.x ### Are you willing to submit PR? - [ ] Yes I am willing to submit a PR! ### Code of Conduct - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
