howardyoo opened a new issue, #37628: URL: https://github.com/apache/airflow/issues/37628
### Description Opentelemetry (https://opentelemetry.io/) is quickly becoming the standard of sending telemetry data such as metrics, logs, and traces) to any targets supporting its protocol. Airflow as a popular choice of data pipelines need to send opentelemetry telemetry to any targets during its operation to make the pipeline be observed by many monitoring/observability tools currently available. This feature for OpenTelemetry will contain plugins, listeners, and hooks to make it easy for users to send out their own telemetry data via OpenTelemetry standards. ### Use case/motivation By providing 'opentelemetry provider' for airflow, user can easily use the provider that contains : 1. listeners - to listen for task runs and dag runs, and emit them out as opentelemetry traces to configured OTEL endpoint. 2. provider opentelemetry hooks for users sending out metrics, traces, and logs using opentelemetry within their DAG source codes ### Related issues None ### Are you willing to submit a PR? - [X] Yes I am willing to submit a PR! ### Code of Conduct - [X] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
