Aman-Rathi1 opened a new issue, #47374: URL: https://github.com/apache/airflow/issues/47374
### Apache Airflow version 2.10.5 ### If "Other Airflow 2 version" selected, which one? _No response_ ### What happened? Upon initial setup of Airflow and StatsD, everything functions as expected. However, if StatsD is restarted or becomes temporarily unavailable, Airflow stops sending metrics to StatsD. The issue persists until an Airflow restart is performed, after which metrics are sent again as expected. ### What you think should happen instead? Scheduler should keep sending metrics even after restart of statsd ### How to reproduce **Steps to Reproduce:** 1. Set up Airflow to send metrics to StatsD ( in separate docker containers ). 2. Command to run statsd: docker _run_ --rm -p 9102:9102 -p 9125:9125 -p 9125:9125/udp quay.io/prometheus/statsd-exporter:v0.26.1 --log.level=debug 3. Command to run airflow: CMD: _docker run -it --replace --env AIRFLOW__METRICS__STATSD_ON=true --env AIRFLOW__METRICS__STATSD_HOST=localhost --env AIRFLOW__METRICS__STATSD_PORT=9125 --env AIRFLOW__METRICS__STATSD_PREFIX=airflow --name airflow --env AIRFLOW__CORE__LOGGING_LEVEL=DEBUG --env AIRFLOW__LOGGING__LOGGING_LEVEL=DEBUG --env AIRFLOW_METRICS_USE_PATTERN_MATCH=true_ apache/airflow:2.10.5 standalone 4. Confirm that metrics are being sent successfully. 5. Restart or temporarily make StatsD unavailable (e.g., kill the StatsD container and create it again ). 6. Observe that after the disruption, Airflow stops sending metrics to StatsD.Restarting Airflow resolves the issue and metrics are sent again. ### Operating System NAME="Oracle Linux Server" VERSION="9.2" ### Versions of Apache Airflow Providers ❯ pip3 freeze | grep apache-airflow-providers apache-airflow-providers-common-compat==1.5.0 apache-airflow-providers-common-io==1.4.2 apache-airflow-providers-common-sql==1.20.0 apache-airflow-providers-fab==1.5.3 apache-airflow-providers-ftp==3.11.1 apache-airflow-providers-http==4.13.3 apache-airflow-providers-imap==3.7.0 apache-airflow-providers-smtp==1.8.1 apache-airflow-providers-sqlite==3.9.1 ### Deployment Other Docker-based deployment ### Deployment details Deploying Airflow on ECS(Elastic Container Service) ### Anything else? _No response_ ### Are you willing to submit PR? - [ ] Yes I am willing to submit a PR! ### Code of Conduct - [x] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
