potiuk commented on issue #8743: URL: https://github.com/apache/airflow/issues/8743#issuecomment-1130077614
> airflow metrics are the actual example that DataDog uses Nice. Also I think the right solution to that is to add open-telemetry support rather than extend Airflow's DataDog StatsD integration. We have a nice AIP (Airflow Improvement Proposal): https://cwiki.apache.org/confluence/display/AIRFLOW/AIP-49+OpenTelemetry+Support+for+Apache+Airflow and discussion https://lists.apache.org/thread/1sdz7mx8j495h5vddngrwpxbx03p04z6 where any comments are welcome. The proposal there covers much more comprehensive approach for the Open-Telemetry integration and I think we should rather focus on makitng it happen rather than changing our DataDog or StatsD integration. DataDog already support OTel integration and once we implement OTel in Airlfow, not only you will be able to plugin the metrics but also all other telemetry data including detailed metrics of Airflow internals, Traces that will allow you to trace task and dag execution across multiple components as well as (in the future) logging. And not only with Datadog but with all the other telemetry services. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
