Hello Cht G, These metrics values do indeed look very suspicious!
By *convention*, counters can only increase and should never be negative (like the total number of requests). Gauges however, can take on any value (like temperature). What you outline above sounds like a bug in the upstream Argo project, and you should raise it with them directly. Best, Ian On Fri, Jun 18, 2021 at 9:11 PM Cht G <[email protected]> wrote: > I am monitoring argo workflow with Prometheus. > argo_workflows_count{status="Error"} -82 > argo_workflows_count{status="Failed"} -63 > argo_workflows_count{status="Running"} 74 > argo_workflows_count{status="Pending"} 484 > argo_workflows_count{status="Succeeded"} -402 > the value is negative, How could the error count, succeeded will be > negative...? > > -- > You received this message because you are subscribed to the Google Groups > "Prometheus Users" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [email protected]. > To view this discussion on the web visit > https://groups.google.com/d/msgid/prometheus-users/eb0217b3-ae5b-4acd-982f-0b9cbcd297e1n%40googlegroups.com > <https://groups.google.com/d/msgid/prometheus-users/eb0217b3-ae5b-4acd-982f-0b9cbcd297e1n%40googlegroups.com?utm_medium=email&utm_source=footer> > . > -- You received this message because you are subscribed to the Google Groups "Prometheus Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/prometheus-users/CADoMBNXxTcSrm7D1FhQDM3SyQoF0rZZ_UTDnHiaOG6Z%3DLge_mQ%40mail.gmail.com.
