Ibraitas commented on issue #41822: URL: https://github.com/apache/airflow/issues/41822#issuecomment-2469921606
> Just a question, are these metrics consistently missing, or randomly missing? Also, what were the names of the metrics? any examples? This could either be due to the metrics name being too longe and getting truncated, or if Airflow did not have enough time to emit the metrics before something terminated. I'll list a few with behaviors - `ti_successes` is missing completely; - `ti.start` is missing completely; - `ti.finish` is missing completely; - `operator` `_successes`, `_failures` are missing in any form; - `executor_running_tasks` does not catch fast executing tasks; - `job_start` is present as it is, not in `<job_name>_start` format and is always equal to 1, and `_end` is not present at all. I tested locally on dag with one task, which is executed once a minute, stably successful. Just in case I attach screenshots of all airflow metrics I see in Prometheus <img width="605" alt="Screenshot 2024-11-12 at 11 38 23" src="https://github.com/user-attachments/assets/8a9a8c74-1751-4e15-90c4-03559ae5f0dd";> <img width="554" alt="Screenshot 2024-11-12 at 11 39 37" src="https://github.com/user-attachments/assets/57bf2d85-bab9-41d7-a35a-a3b12b22cb97";> <img width="659" alt="Screenshot 2024-11-12 at 11 40 13" src="https://github.com/user-attachments/assets/770e7053-4cb5-43e5-a097-b12c28518e74";> <img width="610" alt="Screenshot 2024-11-12 at 11 40 53" src="https://github.com/user-attachments/assets/b9d06fd0-85e0-4eb4-b3f2-d79192aa5c4f";> <img width="665" alt="Screenshot 2024-11-12 at 11 41 11" src="https://github.com/user-attachments/assets/62a74989-43b1-4bcc-99af-b38c3ddea03f";> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
