Found my stupid mistake. It works now. Thanks! I have another query though. This maybe just a ridiculous question, but is there any way I can get the hostnames for the targets I configured as ICMP ping targets for Blackbox exporter? I know Blackbox exporter itself does not expose any hostname but still is there something that can be done?
On Friday, March 6, 2020 at 12:10:57 AM UTC+5:30, Yagyansh S. Kumar wrote: > > Cool, thanks a ton. > > Just one doubt. I have tried and have been using the join method that you > mentioned, in grafana for getting the hostnames as legends but how do I > extract the hostname from the expression in alertmanager? I mean we have > the expression but I am stuck at getting the nodename out of it. > expr: | > (node_filesystem_avail_bytes < 100000000 and > node_filesystem_size_bytes > 100000000) > * on (instance) group_left(nodename) node_uname_info > > Now, how do I extract the nodename? $labels.nodename ? > > On Thursday, March 5, 2020 at 9:43:33 PM UTC+5:30, Brian Candler wrote: >> >> Yes. There are two basic approaches. >> >> The first (and more complex) is to join node_uname_info to pick extra >> labels to add to your alert. Example (untested): >> >> - alert: DiskFull >> expr: | >> (node_filesystem_avail_bytes < 100000000 and >> node_filesystem_size_bytes > 100000000) >> * on (instance) group_left(nodename) node_uname_info >> >> More info: >> * https://www.robustperception.io/how-to-have-labels-for-machine-roles >> * >> https://www.robustperception.io/exposing-the-software-version-to-prometheus >> * https://www.robustperception.io/left-joins-in-promql >> >> The downside is that it makes all your alerting rules more complex. >> >> The second approach, specifically for your problem of having the >> hostnames in alerts, is to put a meaningful name in the "instance" label, >> rather than the IP address. This approach is described here: >> >> * >> https://www.robustperception.io/target-labels-are-for-life-not-just-for-christmas/ >> * >> https://www.slideshare.net/roidelapluie/taking-advantage-of-prometheus-relabeling-109483749 >> >> This makes not only alerts but also dashboards much more usable. >> >> Taking this to the limit, I create my targets files with entries of the >> form "foo/1.2.3.4" and use relabelling so that the name "foo" ends up in >> the instance label, and the IP address is the target which is actually >> scraped. Details: >> https://groups.google.com/d/msg/prometheus-users/VafEFQQKdWc/YrChiAePBQAJ >> >> -- You received this message because you are subscribed to the Google Groups "Prometheus Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/prometheus-users/11a886bc-5ded-42bb-9eb4-61c033322723%40googlegroups.com.
