On 16/02/2020 09:52, bryan wrote:
okay, I checked the alertmanager's log, for example, see below:
level=debug ts=2020-02-16T00:41:46.642829251Z caller=dispatch.go:104
component=dispatcher msg="Received alert" alert=Watchdog[e1749c6][active]
level=debug ts=2020-02-16T00:41:49.181048151Z caller=dispatch.go:104
component=dispatcher msg="Received alert"
alert=MemeryUsagePercentageHigh[3889cfa][active]
level=debug ts=2020-02-16T00:41:51.761879845Z caller=nflog.go:538
component=nflog msg="gossiping new entry"
entry="entry:<group_key:\"{}/{severity=\\\"warning\\\"}:{alertname=\\\"MemeryUsagePercentageHigh\\\"}\"
receiver:<group_name:\"webhook\" integration:\"webhook\" >
timestamp:<seconds:1581813737 nanos:577614310 >
firing_alerts:6164213166729845817 > expires_at:<seconds:1582245737
nanos:577614310 > "
level=debug ts=2020-02-16T00:41:51.761992675Z caller=nflog.go:538
component=nflog msg="gossiping new entry"
entry="entry:<group_key:\"{}/{severity=\\\"warning\\\"}:{alertname=\\\"MemeryUsagePercentageHigh\\\"}\"
receiver:<group_name:\"webhook\" integration:\"webhook\" idx:1 >
timestamp:<seconds:1581813737 nanos:575755098 >
firing_alerts:6164213166729845817 > expires_at:<seconds:1582245737
nanos:575755098 > "
level=debug ts=2020-02-16T00:42:27.873139582Z caller=cluster.go:295
component=cluster memberlist="2020/02/16 00:42:27 [DEBUG] memberlist:
Initiating push/pull sync with: 10.222.5.103:6783\n"
but I don't know which log means send firing email and resoved email,
maybe "msg="gossiping new entry"" means send a alert email? but it's
not exactly, cos I find a similar message but not received email, so I
feel confused, could you explain it for me? I have set the log file in
attachment, maybe you can check it.
In addition, I can't see the prometheus process's relevant log about
sending alert, how can I confirm that alertmanager have received the
original alert or the prometheus have send message to alertmanager?
thank you.
You may have to turn on "debug" level logging.
Are you running an alertmanager cluster?
https://github.com/prometheus/alertmanager#high-availability
That would explain the "gossiping" - and maybe one of the cluster
members is having problems sending E-mail.
--
You received this message because you are subscribed to the Google Groups
"Prometheus Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to [email protected].
To view this discussion on the web visit
https://groups.google.com/d/msgid/prometheus-users/a46732fb-f47b-5040-1f0e-2eed3e87d8b9%40pobox.com.
