internetcoffeephone opened a new issue #18604: URL: https://github.com/apache/airflow/issues/18604
### Description Allow multiple simultaneous remote logging methods. ### Use case/motivation Currently, Airflow only allows for one remote logging option at a time. This is done in the block starting here: https://github.com/apache/airflow/blob/c4fd84accd143977cba57e4daf6daef2af2ff457/airflow/config_templates/airflow_local_settings.py#L172 It would be nice if you could use multiple TaskHandlers at the same time: e.g. to use [S3TaskHandler](https://airflow.apache.org/docs/apache-airflow-providers-amazon/stable/_api/airflow/providers/amazon/aws/log/s3_task_handler/index.html#airflow.providers.amazon.aws.log.s3_task_handler.S3TaskHandler) and a custom logging TaskHandler, so that logs are written to both. My particular use case is that I want all logs to be written to S3, and that a subset of the logs is also written to Kafka. Currently this is not possible without forking Airflow. ### Related issues _No response_ ### Are you willing to submit a PR? - [ ] Yes I am willing to submit a PR! ### Code of Conduct - [X] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
