punx120 opened a new issue, #56366: URL: https://github.com/apache/airflow/issues/56366
### Apache Airflow version 2.11.0 ### If "Other Airflow 2 version" selected, which one? _No response_ ### What happened? Hi, The triggerer process keeps log file open even after the trigger is completed. This creates issues with too many files open after a few days or running. Increasing the max number of open file doesn't fix all the problem, as it breaks the `select` method which can only handle FD up to 1024 (https://github.com/python/cpython/blob/12805ef9dac1d564fef222d632dcb4063117bc32/Modules/selectmodule.c#L175). I'm not very familiar in our python manager the logger and when it closes the file it initially opened. Thanks Sylvain ### What you think should happen instead? _No response_ ### How to reproduce Run a trigger and check that the file descriptor is still opened: ``` $ ls -lart /proc/<trigger pid>/fd ``` ### Operating System linux ### Versions of Apache Airflow Providers _No response_ ### Deployment Official Apache Airflow Helm Chart ### Deployment details _No response_ ### Anything else? _No response_ ### Are you willing to submit PR? - [x] Yes I am willing to submit a PR! ### Code of Conduct - [x] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
