GitHub user ferruzzi added a comment to the discussion: Invalid metric values for completed tasks task.cpu_usage_percent/task.mem_usage_percent
It's an interesting one. As it stands, the metric emits the current loads every so often, but there is no code in the task cleanup stage which triggers that to update down (is downdate a word?) to 0%. It would be an interesting puzzle. At what point should that get zeroed out? If it is done during the cleanup stage and something happens, then it's misleading because it hasn't actually finished yet. Perhaps some kind of check for "get all the tasks which have completed since the last time these metrics were updated and zero out their resource metrics"? I wonder if this can be handled on the user/dashboarding end, something like "if the percentages haven't been updated after a certain amount of time then display them as zero"? GitHub link: https://github.com/apache/airflow/discussions/43460#discussioncomment-11083405 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected]
