Dear Brain,
Thanks for the response, here is one of the alert that is causing this
behaviour
apiVersion: v1
data:
alerting_rules.yml: |
groups:
- name: k8s.rules
rules:
- alert: Health down Alert
annotations:
description: Attention !!! Health of dict-service in {{
$labels.locale }} is
down !!!. Current value is {{ $value}} percent
summary: Health of dict-service for {{ $labels.locale }} is
down !!!
expr:
sum(stackdriver_aws_ec_2_instance_logging_googleapis_com_user_azure_qaops_client_health_successrate_sum{tier=~".*",rampcode=~"dict",
region=~".*"}) by (locale) /
sum(stackdriver_aws_ec_2_instance_logging_googleapis_com_user_azure_qaops_client_health_successrate_count{tier=~".*",rampcode=~"dict",
region=~".*"}) by (locale) >= 80 < 99
for: 5m
labels:
severity: warning
- alert: Health down Alert
annotations:
description: Attention !!! Health of dict-service for {{
$labels.locale }} is
down !!!. Current value is {{ $value}} %
summary: Health of dict-service for {{ $labels.locale }} is
down !!!
expr:
sum(stackdriver_aws_ec_2_instance_logging_googleapis_com_user_azure_qaops_client_health_successrate_sum{tier=~".*",rampcode=~"dict",
region=~".*"}) by (locale) /
sum(stackdriver_aws_ec_2_instance_logging_googleapis_com_user_azure_qaops_client_health_successrate_count{tier=~".*",rampcode=~"dict",
region=~".*"}) by (locale) >= 0 < 80
for: 5m
labels:
severity: critical
--> Alertmanager version is 0.20
--> Prometheus version is ( Actually we are working with Thanos ) Version :
0.11
--> Both alertmanager and Prometheus are hosted as a stateful set and
accessed as a stateless service
On Tue, Apr 28, 2020 at 1:55 PM Brian Candler <[email protected]> wrote:
> On Tuesday, 28 April 2020 08:56:21 UTC+1, piyush sharma wrote:
>>
>> I am badly stuck in a problem .
>> One main thing is that .. alert manager sends resolve notification on its
>> own but the alert is still active.
>> I want to disable this feature. I want "resolved " alert to be sent only
>> when alert is really resolved.
>>
>
>
> That's not true. Alertmanager only sends resolved messages when the alert
> is resolved.
>
> You therefore need to describe your setup further, in particular:
>
> - what is the alerting rule which is generating this alert?
>
> - are you using any sort of clustering?
>
> And of course, it never hurts to mention the versions of prometheus and
> alertmanager you are running.
>
> --
> You received this message because you are subscribed to the Google Groups
> "Prometheus Users" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to [email protected].
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/prometheus-users/6980ded2-9541-4334-b7a5-b62a7fe44058%40googlegroups.com
> <https://groups.google.com/d/msgid/prometheus-users/6980ded2-9541-4334-b7a5-b62a7fe44058%40googlegroups.com?utm_medium=email&utm_source=footer>
> .
>
--
You received this message because you are subscribed to the Google Groups
"Prometheus Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to [email protected].
To view this discussion on the web visit
https://groups.google.com/d/msgid/prometheus-users/CAPz289tqSWsQxMMAGQ6%3DMtJnn_K-bjT9OQHJRxRi9_vXutLtfA%40mail.gmail.com.
