Hi,
Looking for some general advice about shared prom alert rules between
regions. We currently push the same alert rules to all regions, and
sometimes we run into situations where we have a specific job in region X
but not Y.
This is fine for basic cases, such as *up{job="jenkins"} == 0* which will
be ignored in regions where there's no jenkins job present (or could easily
specify region="X").
But in some situations I'd like to use absent on a metric that often has
gaps for example
*absent(jenkins_up{job="jenkins"})*
This would trigger in all regions, whether or not there's a job "jenkins"
(obviously because it's triggering on the missing metrics) even if I try to
be more specific: *absent(jenkins_up{job="jenkins", region="US"}).*
Any suggestions how I can craft an alert query using absent() in on metrics
that don't appear in all regions? So that if region="US" has job="jenkins"
and I watch to catch gaps here, it won't also fire in region="EU" which
never has job="jenkins".... ?
Thanks for any advice.
Dan
--
You received this message because you are subscribed to the Google Groups
"Prometheus Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to [email protected].
To view this discussion on the web visit
https://groups.google.com/d/msgid/prometheus-users/e2724a54-f21a-4632-aea4-2bc67054cd39n%40googlegroups.com.
