ORuteMa opened a new pull request, #14324: URL: https://github.com/apache/dolphinscheduler/pull/14324
Remove StateCheck for SubProcess/DependTask which will cause task submission madness in the default state-wheel-interval configuration Close https://github.com/apache/dolphinscheduler/issues/14262 In dev I found pr https://github.com/apache/dolphinscheduler/pull/14242 has already fix this. However, the description of PR14242 misses an important part: the statecheck can actually result in a large number of SubProcess/DependTask scenarios where the workflow cannot run successfully due to excessive task submission. This issue should be fixed in version 3.1.8, otherwise 3.1.x is not available with default parameters in such a scenario, `state-wheel-interval` is default 5 which will cause 200 statecheck task submitted in a second. What's worse is that once the task is success, the previous state events are all in exception, cause slower event handling.  From my pratice, it can be stuck for 10+ hours. cc @ruanwenjun @zhuangchong ## Purpose of the pull request Fix task submission madness in 3.1.x ## Brief change log Remove StateCheck for SubProcess/DependTask ## Verify this pull request This pull request is code cleanup without any test coverage. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
