Notification Type: RECOVERY
Service: Free space - all mounts
Host: deployment-fluorine02
Address: 10.68.23.106
State: OK
Date/Time: Fri 15 Dec 06:55:36 UTC 2017
Notes URLs:
Additional Info:
OK: All targets OK
___
Betacluster-alerts mailing list
Notification Type: PROBLEM
Service: Mediawiki Error Rate
Host: Graphite Labs
Address: graphite-labs.wikimedia.org
State: WARNING
Date/Time: Fri 15 Dec 05:25:07 UTC 2017
Notes URLs:
Additional Info:
WARNING: 80.00% of data above the warning threshold [1.0]
Notification Type: PROBLEM
Service: Puppet staleness
Host: deployment-restbase02
Address: 10.68.17.189
State: CRITICAL
Date/Time: Fri 15 Dec 05:22:25 UTC 2017
Notes URLs:
Additional Info:
CRITICAL: 100.00% of data above the critical threshold [43200.0]
Notification Type: PROBLEM
Service: Mediawiki Error Rate
Host: Graphite Labs
Address: graphite-labs.wikimedia.org
State: CRITICAL
Date/Time: Fri 15 Dec 05:20:10 UTC 2017
Notes URLs:
Additional Info:
CRITICAL: 20.00% of data above the critical threshold [10.0]
Notification Type: PROBLEM
Service: Mediawiki Error Rate
Host: Graphite Labs
Address: graphite-labs.wikimedia.org
State: WARNING
Date/Time: Fri 15 Dec 05:15:08 UTC 2017
Notes URLs:
Additional Info:
WARNING: 60.00% of data above the warning threshold [1.0]
Notification Type: PROBLEM
Service: Puppet staleness
Host: deployment-restbase01
Address: 10.68.16.128
State: CRITICAL
Date/Time: Fri 15 Dec 04:59:27 UTC 2017
Notes URLs:
Additional Info:
CRITICAL: 100.00% of data above the critical threshold [43200.0]
Notification Type: PROBLEM
Service: Mediawiki Error Rate
Host: Graphite Labs
Address: graphite-labs.wikimedia.org
State: CRITICAL
Date/Time: Fri 15 Dec 04:50:08 UTC 2017
Notes URLs:
Additional Info:
CRITICAL: 20.00% of data above the critical threshold [10.0]
Notification Type: PROBLEM
Service: Mediawiki Error Rate
Host: Graphite Labs
Address: graphite-labs.wikimedia.org
State: WARNING
Date/Time: Fri 15 Dec 04:45:08 UTC 2017
Notes URLs:
Additional Info:
WARNING: 80.00% of data above the warning threshold [1.0]
Notification Type: PROBLEM
Service: Free space - all mounts
Host: deployment-fluorine02
Address: 10.68.23.106
State: CRITICAL
Date/Time: Fri 15 Dec 03:20:37 UTC 2017
Notes URLs:
Additional Info:
CRITICAL: deployment-prep.deployment-fluorine02.diskspace._srv.byte_percentfree
(<55.56%)
Notification Type: PROBLEM
Service: Puppet errors
Host: deployment-tin
Address: 10.68.21.205
State: CRITICAL
Date/Time: Fri 15 Dec 02:49:20 UTC 2017
Notes URLs:
Additional Info:
CRITICAL: 55.56% of data above the critical threshold [0.0]
___
Notification Type: PROBLEM
Service: Puppet errors
Host: deployment-mira
Address: 10.68.20.135
State: CRITICAL
Date/Time: Fri 15 Dec 02:43:29 UTC 2017
Notes URLs:
Additional Info:
CRITICAL: 33.33% of data above the critical threshold [0.0]
___
Notification Type: RECOVERY
Service: Puppet errors
Host: deployment-tin
Address: 10.68.21.205
State: OK
Date/Time: Fri 15 Dec 01:53:20 UTC 2017
Notes URLs:
Additional Info:
OK: Less than 1.00% above the threshold [0.0]
___
Betacluster-alerts
Notification Type: PROBLEM
Service: Free space - all mounts
Host: deployment-fluorine02
Address: 10.68.23.106
State: WARNING
Date/Time: Fri 15 Dec 00:20:37 UTC 2017
Notes URLs:
Additional Info:
WARNING: deployment-prep.deployment-fluorine02.diskspace._srv.byte_percentfree
(<55.56%)
Notification Type: PROBLEM
Service: Puppet errors
Host: deployment-kafka-jumbo-1
Address: 10.68.23.243
State: CRITICAL
Date/Time: Thu 14 Dec 23:37:24 UTC 2017
Notes URLs:
Additional Info:
CRITICAL: 100.00% of data above the critical threshold [0.0]
Notification Type: PROBLEM
Service: Puppet errors
Host: deployment-netbox
Address: 10.68.19.203
State: CRITICAL
Date/Time: Thu 14 Dec 23:36:08 UTC 2017
Notes URLs:
Additional Info:
CRITICAL: 100.00% of data above the critical threshold [0.0]
___
Notification Type: PROBLEM
Service: Puppet errors
Host: deployment-kafka-jumbo-2
Address: 10.68.16.87
State: CRITICAL
Date/Time: Thu 14 Dec 23:30:56 UTC 2017
Notes URLs:
Additional Info:
CRITICAL: 100.00% of data above the critical threshold [0.0]
Notification Type: PROBLEM
Service: Puppet errors
Host: deployment-etcd-01
Address: 10.68.19.227
State: CRITICAL
Date/Time: Thu 14 Dec 22:35:42 UTC 2017
Notes URLs:
Additional Info:
CRITICAL: 22.22% of data above the critical threshold [0.0]
___
Notification Type: PROBLEM
Service: Puppet errors
Host: deployment-sentry01
Address: 10.68.19.148
State: CRITICAL
Date/Time: Thu 14 Dec 22:20:13 UTC 2017
Notes URLs:
Additional Info:
CRITICAL: 60.00% of data above the critical threshold [0.0]
___
Notification Type: RECOVERY
Service: Long lived cherry-picks on puppetmaster
Host: deployment-puppetmaster02
Address: 10.68.21.200
State: OK
Date/Time: Thu 14 Dec 22:14:44 UTC 2017
Notes URLs:
Additional Info:
OK: Less than 100.00% above the threshold [0.0]
Notification Type: PROBLEM
Service: Mediawiki Error Rate
Host: Graphite Labs
Address: graphite-labs.wikimedia.org
State: WARNING
Date/Time: Thu 14 Dec 19:18:08 UTC 2017
Notes URLs:
Additional Info:
WARNING: 40.00% of data above the warning threshold [1.0]
Notification Type: RECOVERY
Service: Mediawiki Error Rate
Host: Graphite Labs
Address: graphite-labs.wikimedia.org
State: OK
Date/Time: Thu 14 Dec 19:06:08 UTC 2017
Notes URLs:
Additional Info:
OK: Less than 1.00% above the threshold [1.0]
___
Notification Type: PROBLEM
Service: Mediawiki Error Rate
Host: Graphite Labs
Address: graphite-labs.wikimedia.org
State: WARNING
Date/Time: Thu 14 Dec 18:51:07 UTC 2017
Notes URLs:
Additional Info:
WARNING: 40.00% of data above the warning threshold [1.0]
Notification Type: RECOVERY
Service: Puppet errors
Host: deployment-tmh01
Address: 10.68.16.211
State: OK
Date/Time: Thu 14 Dec 16:52:55 UTC 2017
Notes URLs:
Additional Info:
OK: Less than 1.00% above the threshold [0.0]
___
Betacluster-alerts
Notification Type: PROBLEM
Service: Puppet errors
Host: deployment-redis02
Address: 10.68.16.231
State: CRITICAL
Date/Time: Thu 14 Dec 15:33:41 UTC 2017
Notes URLs:
Additional Info:
CRITICAL: 100.00% of data above the critical threshold [0.0]
___
Notification Type: PROBLEM
Service: Puppet errors
Host: deployment-redis01
Address: 10.68.16.177
State: CRITICAL
Date/Time: Thu 14 Dec 15:27:43 UTC 2017
Notes URLs:
Additional Info:
CRITICAL: 100.00% of data above the critical threshold [0.0]
___
Notification Type: PROBLEM
Service: Puppet errors
Host: deployment-redis06
Address: 10.68.20.16
State: CRITICAL
Date/Time: Thu 14 Dec 15:15:00 UTC 2017
Notes URLs:
Additional Info:
CRITICAL: 100.00% of data above the critical threshold [0.0]
___
Notification Type: RECOVERY
Service: Puppet errors
Host: deployment-sca01
Address: 10.68.20.183
State: OK
Date/Time: Thu 14 Dec 14:19:05 UTC 2017
Notes URLs:
Additional Info:
OK: Less than 1.00% above the threshold [0.0]
___
Betacluster-alerts
Notification Type: RECOVERY
Service: Puppet errors
Host: deployment-db04
Address: 10.68.18.35
State: OK
Date/Time: Thu 14 Dec 14:18:58 UTC 2017
Notes URLs:
Additional Info:
OK: Less than 1.00% above the threshold [0.0]
___
Betacluster-alerts
Notification Type: RECOVERY
Service: Puppet errors
Host: deployment-imagescaler02
Address: 10.68.18.233
State: OK
Date/Time: Thu 14 Dec 14:18:44 UTC 2017
Notes URLs:
Additional Info:
OK: Less than 1.00% above the threshold [0.0]
___
Notification Type: RECOVERY
Service: Puppet errors
Host: deployment-kafka05
Address: 10.68.21.106
State: OK
Date/Time: Thu 14 Dec 14:18:01 UTC 2017
Notes URLs:
Additional Info:
OK: Less than 1.00% above the threshold [0.0]
___
Betacluster-alerts
Notification Type: RECOVERY
Service: Puppet errors
Host: deployment-aqs01
Address: 10.68.18.237
State: OK
Date/Time: Thu 14 Dec 14:17:37 UTC 2017
Notes URLs:
Additional Info:
OK: Less than 1.00% above the threshold [0.0]
___
Betacluster-alerts
Notification Type: RECOVERY
Service: Puppet errors
Host: deployment-memc06
Address: 10.68.22.239
State: OK
Date/Time: Thu 14 Dec 14:17:46 UTC 2017
Notes URLs:
Additional Info:
OK: Less than 1.00% above the threshold [0.0]
___
Betacluster-alerts
Notification Type: RECOVERY
Service: Puppet errors
Host: deployment-elastic05
Address: 10.68.20.21
State: OK
Date/Time: Thu 14 Dec 14:17:35 UTC 2017
Notes URLs:
Additional Info:
OK: Less than 1.00% above the threshold [0.0]
___
Betacluster-alerts
Notification Type: RECOVERY
Service: Puppet errors
Host: deployment-cassandra3-01
Address: 10.68.17.103
State: OK
Date/Time: Thu 14 Dec 14:16:53 UTC 2017
Notes URLs:
Additional Info:
OK: Less than 1.00% above the threshold [0.0]
___
Notification Type: RECOVERY
Service: Puppet errors
Host: deployment-cumin
Address: 10.68.21.105
State: OK
Date/Time: Thu 14 Dec 14:16:53 UTC 2017
Notes URLs:
Additional Info:
OK: Less than 1.00% above the threshold [0.0]
___
Betacluster-alerts
Notification Type: RECOVERY
Service: Puppet errors
Host: deployment-changeprop
Address: 10.68.16.88
State: OK
Date/Time: Thu 14 Dec 14:16:02 UTC 2017
Notes URLs:
Additional Info:
OK: Less than 1.00% above the threshold [0.0]
___
Betacluster-alerts
Notification Type: RECOVERY
Service: Puppet errors
Host: deployment-mediawiki07
Address: 10.68.17.40
State: OK
Date/Time: Thu 14 Dec 14:15:10 UTC 2017
Notes URLs:
Additional Info:
OK: Less than 1.00% above the threshold [0.0]
___
Betacluster-alerts
Notification Type: RECOVERY
Service: Puppet errors
Host: deployment-parsoid09
Address: 10.68.20.142
State: OK
Date/Time: Thu 14 Dec 14:14:46 UTC 2017
Notes URLs:
Additional Info:
OK: Less than 1.00% above the threshold [0.0]
___
Betacluster-alerts
Notification Type: RECOVERY
Service: Puppet errors
Host: deployment-etcd-01
Address: 10.68.19.227
State: OK
Date/Time: Thu 14 Dec 14:14:41 UTC 2017
Notes URLs:
Additional Info:
OK: Less than 1.00% above the threshold [0.0]
___
Betacluster-alerts
Notification Type: RECOVERY
Service: Puppet errors
Host: deployment-redis05
Address: 10.68.19.242
State: OK
Date/Time: Thu 14 Dec 14:14:22 UTC 2017
Notes URLs:
Additional Info:
OK: Less than 1.00% above the threshold [0.0]
___
Betacluster-alerts
Notification Type: RECOVERY
Service: Puppet errors
Host: deployment-cache-text04
Address: 10.68.18.103
State: OK
Date/Time: Thu 14 Dec 14:14:04 UTC 2017
Notes URLs:
Additional Info:
OK: Less than 1.00% above the threshold [0.0]
___
Notification Type: RECOVERY
Service: Puppet errors
Host: deployment-cpjobqueue
Address: 10.68.22.161
State: OK
Date/Time: Thu 14 Dec 14:13:30 UTC 2017
Notes URLs:
Additional Info:
OK: Less than 1.00% above the threshold [0.0]
___
Betacluster-alerts
Notification Type: RECOVERY
Service: Puppet errors
Host: deployment-sca02
Address: 10.68.20.153
State: OK
Date/Time: Thu 14 Dec 14:13:28 UTC 2017
Notes URLs:
Additional Info:
OK: Less than 1.00% above the threshold [0.0]
___
Betacluster-alerts
Notification Type: PROBLEM
Service: Puppet errors
Host: deployment-db04
Address: 10.68.18.35
State: CRITICAL
Date/Time: Thu 14 Dec 13:43:56 UTC 2017
Notes URLs:
Additional Info:
CRITICAL: 50.00% of data above the critical threshold [0.0]
___
Notification Type: PROBLEM
Service: Puppet errors
Host: deployment-imagescaler02
Address: 10.68.18.233
State: CRITICAL
Date/Time: Thu 14 Dec 13:43:43 UTC 2017
Notes URLs:
Additional Info:
CRITICAL: 60.00% of data above the critical threshold [0.0]
Notification Type: PROBLEM
Service: Puppet errors
Host: deployment-elastic05
Address: 10.68.20.21
State: CRITICAL
Date/Time: Thu 14 Dec 13:42:35 UTC 2017
Notes URLs:
Additional Info:
CRITICAL: 66.67% of data above the critical threshold [0.0]
___
Notification Type: PROBLEM
Service: Puppet errors
Host: deployment-memc06
Address: 10.68.22.239
State: CRITICAL
Date/Time: Thu 14 Dec 13:42:44 UTC 2017
Notes URLs:
Additional Info:
CRITICAL: 60.00% of data above the critical threshold [0.0]
___
Notification Type: PROBLEM
Service: Puppet errors
Host: deployment-etcd-01
Address: 10.68.19.227
State: CRITICAL
Date/Time: Thu 14 Dec 13:39:41 UTC 2017
Notes URLs:
Additional Info:
CRITICAL: 66.67% of data above the critical threshold [0.0]
___
Notification Type: PROBLEM
Service: Puppet errors
Host: deployment-sca01
Address: 10.68.20.183
State: CRITICAL
Date/Time: Thu 14 Dec 13:39:04 UTC 2017
Notes URLs:
Additional Info:
CRITICAL: 22.22% of data above the critical threshold [0.0]
___
Notification Type: PROBLEM
Service: Puppet errors
Host: deployment-cpjobqueue
Address: 10.68.22.161
State: CRITICAL
Date/Time: Thu 14 Dec 13:38:31 UTC 2017
Notes URLs:
Additional Info:
CRITICAL: 50.00% of data above the critical threshold [0.0]
___
Notification Type: PROBLEM
Service: Puppet errors
Host: deployment-kafka05
Address: 10.68.21.106
State: CRITICAL
Date/Time: Thu 14 Dec 13:38:00 UTC 2017
Notes URLs:
Additional Info:
CRITICAL: 20.00% of data above the critical threshold [0.0]
___
Notification Type: PROBLEM
Service: Puppet errors
Host: deployment-aqs01
Address: 10.68.18.237
State: CRITICAL
Date/Time: Thu 14 Dec 13:37:38 UTC 2017
Notes URLs:
Additional Info:
CRITICAL: 22.22% of data above the critical threshold [0.0]
___
Notification Type: PROBLEM
Service: Puppet errors
Host: deployment-cassandra3-01
Address: 10.68.17.103
State: CRITICAL
Date/Time: Thu 14 Dec 13:36:54 UTC 2017
Notes URLs:
Additional Info:
CRITICAL: 40.00% of data above the critical threshold [0.0]
Notification Type: PROBLEM
Service: Puppet errors
Host: deployment-cumin
Address: 10.68.21.105
State: CRITICAL
Date/Time: Thu 14 Dec 13:36:54 UTC 2017
Notes URLs:
Additional Info:
CRITICAL: 30.00% of data above the critical threshold [0.0]
___
Notification Type: PROBLEM
Service: Puppet errors
Host: deployment-changeprop
Address: 10.68.16.88
State: CRITICAL
Date/Time: Thu 14 Dec 13:36:01 UTC 2017
Notes URLs:
Additional Info:
CRITICAL: 20.00% of data above the critical threshold [0.0]
___
Notification Type: PROBLEM
Service: Puppet errors
Host: deployment-videoscaler01
Address: 10.68.19.130
State: CRITICAL
Date/Time: Thu 14 Dec 13:35:41 UTC 2017
Notes URLs:
Additional Info:
CRITICAL: 40.00% of data above the critical threshold [0.0]
Notification Type: PROBLEM
Service: Puppet errors
Host: deployment-mediawiki07
Address: 10.68.17.40
State: CRITICAL
Date/Time: Thu 14 Dec 13:35:09 UTC 2017
Notes URLs:
Additional Info:
CRITICAL: 22.22% of data above the critical threshold [0.0]
___
Notification Type: PROBLEM
Service: Puppet errors
Host: deployment-parsoid09
Address: 10.68.20.142
State: CRITICAL
Date/Time: Thu 14 Dec 13:34:47 UTC 2017
Notes URLs:
Additional Info:
CRITICAL: 40.00% of data above the critical threshold [0.0]
___
Notification Type: PROBLEM
Service: Puppet errors
Host: deployment-redis05
Address: 10.68.19.242
State: CRITICAL
Date/Time: Thu 14 Dec 13:34:24 UTC 2017
Notes URLs:
Additional Info:
CRITICAL: 30.00% of data above the critical threshold [0.0]
___
Notification Type: PROBLEM
Service: Puppet errors
Host: deployment-cache-text04
Address: 10.68.18.103
State: CRITICAL
Date/Time: Thu 14 Dec 13:34:04 UTC 2017
Notes URLs:
Additional Info:
CRITICAL: 44.44% of data above the critical threshold [0.0]
Notification Type: PROBLEM
Service: Puppet errors
Host: deployment-sca02
Address: 10.68.20.153
State: CRITICAL
Date/Time: Thu 14 Dec 13:33:29 UTC 2017
Notes URLs:
Additional Info:
CRITICAL: 20.00% of data above the critical threshold [0.0]
___
Notification Type: RECOVERY
Service: Puppet errors
Host: deployment-sca01
Address: 10.68.20.183
State: OK
Date/Time: Thu 14 Dec 12:48:04 UTC 2017
Notes URLs:
Additional Info:
OK: Less than 1.00% above the threshold [0.0]
___
Betacluster-alerts
Notification Type: PROBLEM
Service: Puppet errors
Host: deployment-sca01
Address: 10.68.20.183
State: CRITICAL
Date/Time: Thu 14 Dec 12:13:04 UTC 2017
Notes URLs:
Additional Info:
CRITICAL: 66.67% of data above the critical threshold [0.0]
___
Notification Type: RECOVERY
Service: Mediawiki Error Rate
Host: Graphite Labs
Address: graphite-labs.wikimedia.org
State: OK
Date/Time: Thu 14 Dec 10:05:09 UTC 2017
Notes URLs:
Additional Info:
OK: Less than 1.00% above the threshold [1.0]
___
Notification Type: PROBLEM
Service: Mediawiki Error Rate
Host: Graphite Labs
Address: graphite-labs.wikimedia.org
State: WARNING
Date/Time: Thu 14 Dec 10:00:08 UTC 2017
Notes URLs:
Additional Info:
WARNING: 40.00% of data above the warning threshold [1.0]
65 matches
Mail list logo
