[prometheus-users] [Announcement] Introducing Alert Analysis

Hello All, I wanted to take a moment to introduce you all to the alert analysis tool that we've been using at Cloudflare. We had the opportunity to present this at PromCon 2023 in Berlin (you can find the details of our talk here ). Additional

Re: [prometheus-users] Re: Need urgent help!!! Want to modify tags "keys" to lowercase scraping from Cloudwatch-Exporter in Prometheus before sending to Mimir #13912

Ok Thanks @ Brian Candler for your valuable time on this. Do you have any idea or way to achieve this in* relabel_configs* or *metric_relabel_configs* On Thursday, April 18, 2024 at 9:05:25 PM UTC+5:30 Brian Candler wrote: > No. That test case demonstrates that it is the label *values* that are

Re: [prometheus-users] Re: Need urgent help!!! Want to modify tags "keys" to lowercase scraping from Cloudwatch-Exporter in Prometheus before sending to Mimir #13912

No. That test case demonstrates that it is the label *values* that are downcased, not the label names, exactly as you said. On Thursday 18 April 2024 at 13:07:51 UTC+1 Vaibhav Ingulkar wrote: > Thanks @Brian Candler > > Actually not possible fixing the data at source due to multiple > variation

Re: [prometheus-users] Re: Need urgent help!!! Want to modify tags "keys" to lowercase scraping from Cloudwatch-Exporter in Prometheus before sending to Mimir #13912

Thanks @Brian Candler Actually not possible fixing the data at source due to multiple variations in diff aws services and huge data modification. So looking to make it dynamically by capturing labels starting with "*tag_*". As mentioned here https://github.com/prometheus/prometheus/blob/v2.45.

Re: [prometheus-users] Re: Need urgent help!!! Want to modify tags "keys" to lowercase scraping from Cloudwatch-Exporter in Prometheus before sending to Mimir #13912

You mean you're seeing tag_owner, tag_Owner, tag_OWNER from different instances? Because the tags weren't entered consistently? I don't see a lowercasing version of the "labelmap" action. So I think you're back to either: 1. fixing the data at source (e.g. using the EC2 API to read the tags and

Re: [prometheus-users] Re: Need urgent help!!! Want to modify tags "keys" to lowercase scraping from Cloudwatch-Exporter in Prometheus before sending to Mimir #13912

Additionally , I have prepare below config under metric_relable_configs - action: labelmap regex: 'tag_(.*)' replacement: $1 It is giving one me new set of all label starting with word '*tag_*' as added in regex but not converting them to lowercase and removing "*tag_*" from label name, for

Re: [prometheus-users] Re: Need urgent help!!! Want to modify tags "keys" to lowercase scraping from Cloudwatch-Exporter in Prometheus before sending to Mimir #13912

Thanks @Brian Kochie Correct me if I am wrong but I think lower/upper action in relabeling works to make "*values*" of labels to lower/upper and not "*keys*" *i.e. label name itself wont get convert to lowercase*. Right? Because I an using *v2.41.0 *and have tried it and it is converting all

Re: [prometheus-users] Re: Need urgent help!!! Want to modify tags "keys" to lowercase scraping from Cloudwatch-Exporter in Prometheus before sending to Mimir #13912

On Thursday 18 April 2024 at 09:42:41 UTC+1 Ben Kochie wrote: Prometheus can lower/upper in relabeling. Thanks! That was added in v2.36.0 , and I missed it. -- You received this message because you are subscribed to the Google Groups

Re: [prometheus-users] Re: Need urgent help!!! Want to modify tags "keys" to lowercase scraping from Cloudwatch-Exporter in Prometheus before sending to Mimir #13912

Prometheus can lower/upper in relabeling. https://prometheus.io/docs/prometheus/latest/configuration/configuration/#relabel_config On Thu, Apr 18, 2024 at 10:28 AM 'Brian Candler' via Prometheus Users < prometheus-users@googlegroups.com> wrote: > > Need urgent help!!! > > See https://www.catb.or

[prometheus-users] Re: Need urgent help!!! Want to modify tags "keys" to lowercase scraping from Cloudwatch-Exporter in Prometheus before sending to Mimir #13912

> Need urgent help!!! See https://www.catb.org/~esr/faqs/smart-questions.html#urgent > we can add *only one pattern (Uppercase or lowercase)* in template code. At worst you can match like this: tag_Name=~"[fF][oO][oO][bB][aA][rR]" I don't know of any way internally to prometheus to lowercase la

[prometheus-users] Need urgent help!!! Want to modify tags "keys" to lowercase scraping from Cloudwatch-Exporter in Prometheus before sending to Mimir #13912

We are using *Cloudwatch-exporter* to scrape cloudwatch metrics and adding exporter job in *Prometheus* to scrape those metrics from exporter and then forwarding those metrics from prometheus to mimir *to enable alerting on metrics.* There is no consistency in *keys* of tags at aws side, due

[prometheus-users] Need urgent help!!! Want to modify tags "keys" to lowercase scraping from Cloudwatch-Exporter in Prometheus before sending to Mimir #13912

We are using **Cloudwatch-exporter** to scrape cloudwatch metrics and adding exporter job in **Prometheus** to scrape those metrics from exporter and then forwarding those metrics from prometheus to mimir **to enable alerting on metrics.** There is no consistency in **keys** of tags at aws side

[prometheus-users] Re: many-to-many not allowed error

Look at the results of each half of the query separately: redis_memory_max_bytes{k8s_cluster_name="$cluster", namespace="$namespace", pod="$pod_name"} redis_instance_info{role=~"master|slave"} You then need to find some set of labels which mean that N entries on the left-hand side alwa

Re: [prometheus-users] Re: Config DNS Prometheus/Blackbox_Exporter

You don't need a separate job for each DNS server. You can have a single job with multiple target blocks. - job_name: 'dns' scrape_interval: 5s metrics_path: /probe params: module: [dns_probe] static_configs: - targets: - www.google.com - www.mindfree