I have something like this:
global:
route:
receiver: alert-emailer-cpu-30m
group_by: ['alertname', 'priority', 'instance']
group_wait: 10s
group_interval: 10s
repeat_interval: 30m
# resolve_timeout: 10s
routes:
#rebooted
- receiver: alert-emailer-reboot-30m
repeat_interval: 30m
match:
severity: "[Rebooted]"
#CPU
- receiver: alert-emailer-cpu-30m
repeat_interval: 1m
match:
severity: "[Disaster-CPU]"
- receiver: alert-emailer-cpu-1h
repeat_interval: 1m
match:
severity: "[High-CPU]"
- receiver: alert-emailer-cpu-3h
repeat_interval: 1m
match:
severity: "[Average-CPU]"
#resolved
- receiver: alert-emailer-cpu-30m-resolved
repeat_interval: 1m
match:
severity: "[Disaster-CPU]"
- receiver: alert-emailer-cpu-1h-resolved
repeat_interval: 1m
match:
severity: "[High-CPU]"
- receiver: alert-emailer-cpu-3h-resolved
repeat_interval: 1m
match:
severity: "[Average-CPU]"
#cpu
- name: alert-emailer-cpu-1h
email_configs:
- to: '[email protected]'
send_resolved: false
from: '******'
smarthost: '******'
auth_username: '******'
auth_password: '******'
auth_secret: '******'
auth_identity:'******'
html: '{{ template "email" .}}'
headers:
subject: "[CUK]{{ .CommonLabels.severity }} {{ .CommonLabels.instance
}} {{ .CommonLabels.alertname }} | {{ .CommonAnnotations.description }}"
- name: alert-emailer-cpu-1h-resolved
email_configs:
- to: '[email protected]'
send_resolved: true
from: '******'
smarthost: '******'
auth_username: '******'
auth_password: '******'
auth_secret: '******'
auth_identity:'******'
html: '{{ template "email" .}}'
headers:
subject: "[CUK][RESOLVED]{{ .CommonLabels.severity }} {{
.CommonLabels.instance }} {{ .CommonLabels.alertname }} | {{
.CommonAnnotations.description }}"
- name: alert-emailer-cpu-30m
email_configs:
- to: '[email protected]'
send_resolved: false
from: '******'
smarthost: '******'
auth_username: '******'
auth_password: '******'
auth_secret: '******'
auth_identity:'******'
html: '{{ template "email" .}}'
headers:
subject: "[CUK]{{ .CommonLabels.severity }} {{ .CommonLabels.instance
}} {{ .CommonLabels.alertname }} | {{ .CommonAnnotations.description }}"
- name: alert-emailer-cpu-30m-resolved
email_configs:
- to: '[email protected]'
send_resolved: true
from: '******'
smarthost: '******'
auth_username: '******'
auth_password: '******'
auth_secret: '******'
auth_identity:'******'
html: '{{ template "email" .}}'
headers:
subject: "[CUK][RESOLVED]{{ .CommonLabels.severity }} {{
.CommonLabels.instance }} {{ .CommonLabels.alertname }} | {{
.CommonAnnotations.description }}"
@Matthias Rampke <[email protected]> so U think i should add
.Alerts.Resolved: {{ if gt (len .Alerts.Firing) 0 }} to alert? Where
prometheus hold's that alert is resolved? I thought in slack it will show
that alert has been resolved, but in prometheus that alert is just green
and show nothing.
wt., 30 mar 2021 o 12:24 Matthias Rampke <[email protected]>
napisał(a):
> I *think* you can have one email config, and toggle whether to show
> [RESOLVED] as part of the template. Looking at the default templates
> <https://github.com/prometheus/alertmanager/blob/master/template/default.tmpl>,
> it seems like the way to do that is to check for the length of
> .Alerts.Firing and .Alerts.Resolved: {{ if gt (len .Alerts.Firing) 0 }} etc.
>
> /MR
>
> On Tue, Mar 30, 2021 at 9:02 AM Stuart Clark <[email protected]>
> wrote:
>
>> On 29/03/2021 14:20, Sebastian Glock wrote:
>> > I tried to do something like this:
>> >
>> > ```
>> > - name: alert-emailer-cpu-1h
>> > email_configs:
>> > - to: '[email protected]'
>> > send_resolved: false
>> > from: '*****'
>> > smarthost:'*****'
>> > auth_username: '*****'
>> > auth_password: '*****'
>> > auth_secret: '*****'
>> > auth_identity:'*****'
>> > html: '{{ template "email" .}}'
>> > headers:
>> > subject: "[CUK]{{ .CommonLabels.severity }} {{
>> > .CommonLabels.instance }} {{ .CommonLabels.alertname }} | {{
>> > .CommonAnnotations.description }}"
>> >
>> > - name: alert-emailer-cpu-1h-resolved
>> > email_configs:
>> > - to: '[email protected]'
>> > send_resolved: true
>> > from: '*****'
>> > smarthost: '*****'
>> > auth_username: '*****'
>> > auth_password: '*****'
>> > auth_secret: '*****'
>> > auth_identity: '*****'
>> > html: '{{ template "email" .}}'
>> > headers:
>> > subject: "[CUK][RESOLVED]{{ .CommonLabels.severity }} {{
>> > .CommonLabels.instance }} {{ .CommonLabels.alertname }} | {{
>> > .CommonAnnotations.description }}"
>> > ```
>> >
>> > 1 alert without send resolved, second with send resolved: true. I
>> > thought i'll get an email "alert-emailer-cpu-1h-resolved" after 5
>> > minutes when 1st alert "alert-emailer-cpu-1h" goes out. Is there any
>> > other way to solve that?
>> >
>> > Thanks for your help!
>>
>> Could you post the whole alertmanager config?
>>
>> --
>> Stuart Clark
>>
>> --
>> You received this message because you are subscribed to the Google Groups
>> "Prometheus Users" group.
>> To unsubscribe from this group and stop receiving emails from it, send an
>> email to [email protected].
>> To view this discussion on the web visit
>> https://groups.google.com/d/msgid/prometheus-users/c6ee84ab-4b5b-9dde-db46-ae45f0dc8944%40Jahingo.com
>> .
>>
>
--
You received this message because you are subscribed to the Google Groups
"Prometheus Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to [email protected].
To view this discussion on the web visit
https://groups.google.com/d/msgid/prometheus-users/CAFn4LSprSEQWcXLiSs1sHRqVP234xjW5M%3D9butey91uO4TESBA%40mail.gmail.com.
