BabySid opened a new issue #8537: URL: https://github.com/apache/dolphinscheduler/issues/8537
### Search before asking - [X] I had searched in the [issues](https://github.com/apache/dolphinscheduler/issues?q=is%3Aissue) and found no similar feature requirement. ### Description There are lots of ETL jobs which run for a long period of time in the scheduler system. When Dolphine restarts, these ETL jobs will be failed and be dispatched to other workers for re execution. This will mainly lead to two problems: one is that the execution time of tasks becomes longer (e.g. task run between 10am to 15pm, i restart the job at 14pm, the job will finish at 19pm. 4 hours more than expected.) second the resources of the cluster are also wasted. So, I propose a feature: asynchronous task. Asynchronous flag can be set on task. A async Task can run detached with the worker process, when worker restart, it can find the original appid then check the task status（running？failed? ...） ### Use case _No response_ ### Related issues _No response_ ### Are you willing to submit a PR? - [ ] Yes I am willing to submit a PR! ### Code of Conduct - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
