howardyoo commented on issue #25254: URL: https://github.com/apache/airflow/issues/25254#issuecomment-1194606372
Traces should be something worth to look into in addressing these sort of data (using logs to track changes? that would be possible, but not ideal), and as @potiuk mentioned, Specifications such as OTEL was made to keep track of these information. Rather than having these information stored inside the airflow's database, these so called `events` can be published out from the airflow into sophisticated third party monitoring tools that can better monitor these sort of information. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
