mert-kirpici opened a new issue, #37266: URL: https://github.com/apache/airflow/issues/37266
### Description I have remote logging enabled, the task logs are nicely being pushed to S3. However the scheduler logs keep growing on disk and afaik there is no way to configure airflow to push them to remote also, or set up some sort of retention period to rotate them without relying on an external mechanism like logrotated or crond. I believe this would be a useful feature. ### Use case/motivation - A new configuration option `scheduler.logging_retention_period` to keep set up the retention period for the scheduler logs AND/OR ( - The `logging.remote_logging` option could also upload scheduler logs to the remote location OR - A new configuration option `scheduler.remote_logging` to be able to push scheduler logs to remote seperately ) ### Related issues _No response_ ### Are you willing to submit a PR? - [ ] Yes I am willing to submit a PR! ### Code of Conduct - [X] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
