Hey,
Since this morning I'm experiencing some very weird behaviors with one of
my counters.
It randomly stays at zero for an hour, then appears again, then again to
zero.
What is strange is that all other metrics are showing up, meaning
prometheus can reach the endpoint, and when I check the endpoint is has the
missing counter in it.
Is there any possible reason that could explain why a counter suddenly only
returns zeros, and then starts working again for no apparent reason?
Please find attached how the graphs look.
The query that returns all zeros:
sum(increase(appbackend_alerts{metric="TEMP", type="TOO_HIGH"}[5m]))
sum(increase(appbackend_alerts{metric="HUMI", type="TOO_HIGH"}[5m]))
The prometheus endpoint returns all those appbackend_alerts lines:
appbackend_alerts{boxID="0",controllerID="xxxxxxxxx",metric="HUMI",type="TOO_HIGH"}
1
appbackend_alerts{boxID="0",controllerID="xxxxxxxxx",metric="HUMI",type="TOO_LOW"}
1
appbackend_alerts{boxID="0",controllerID="xxxxxxxxx",metric="TEMP",type="TOO_LOW"}
1
appbackend_alerts{boxID="0",controllerID="xxxxxxxxx",metric="HUMI",type="TOO_LOW"}
1
appbackend_alerts{boxID="0",controllerID="xxxxxxxxx",metric="HUMI",type="TOO_HIGH"}
1
appbackend_alerts{boxID="0",controllerID="xxxxxxxxx",metric="HUMI",type="TOO_LOW"}
1
appbackend_alerts{boxID="0",controllerID="xxxxxxxxx",metric="HUMI",type="TOO_LOW"}
1
appbackend_alerts{boxID="0",controllerID="xxxxxxxxx",metric="HUMI",type="TOO_HIGH"}
1
[ ... And may more ]
Thanks,
Constantin
--
You received this message because you are subscribed to the Google Groups
"Prometheus Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to [email protected].
To view this discussion on the web visit
https://groups.google.com/d/msgid/prometheus-users/3fda576b-3ca1-42c7-afb0-7cd7451e9982n%40googlegroups.com.