arorasachin9 opened a new issue, #45037: URL: https://github.com/apache/airflow/issues/45037
### Description Currently airflow supports few celery configs only like worker concurrency, worker prefetch multiplier etc. All others config are not supported. One of main out of them is worker max tasks per child which helps in recycling the celery worker processes. It helps in reclaiming the resources of the processes which got consumed due to high resource utilising task. ### Use case/motivation We have a task which consumes very high memory. As task keeps on changing the processes so our memory keeps on increasing. To recycle the process after certain number of task is the celery support but currently not supported in airflow. ### Related issues _No response_ ### Are you willing to submit a PR? - [X] Yes I am willing to submit a PR! ### Code of Conduct - [X] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
