[Betacluster-alerts] ** PROBLEM alert - deployment-kafka01/Free space - all mounts is WARNING **
Notification Type: PROBLEM Service: Free space - all mounts Host: deployment-kafka01 Address: 10.68.21.219 State: WARNING Date/Time: Wed 20 Sep 06:09:02 UTC 2017 Additional Info: WARNING: deployment-prep.deployment-kafka01.diskspace.root.byte_percentfree (<55.56%) ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is WARNING **
Notification Type: PROBLEM Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: WARNING Date/Time: Wed 20 Sep 06:01:48 UTC 2017 Additional Info: WARNING: 80.00% of data above the warning threshold [1.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is CRITICAL **
Notification Type: PROBLEM Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: CRITICAL Date/Time: Wed 20 Sep 05:36:48 UTC 2017 Additional Info: CRITICAL: 40.00% of data above the critical threshold [10.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is WARNING **
Notification Type: PROBLEM Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: WARNING Date/Time: Wed 20 Sep 05:11:48 UTC 2017 Additional Info: WARNING: 80.00% of data above the warning threshold [1.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-fluorine02/Free space - all mounts is WARNING **
Notification Type: PROBLEM Service: Free space - all mounts Host: deployment-fluorine02 Address: 10.68.23.106 State: WARNING Date/Time: Wed 20 Sep 05:10:01 UTC 2017 Additional Info: WARNING: deployment-prep.deployment-fluorine02.diskspace._srv.byte_percentfree (<50.00%) ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is CRITICAL **
Notification Type: PROBLEM Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: CRITICAL Date/Time: Wed 20 Sep 05:06:48 UTC 2017 Additional Info: CRITICAL: 20.00% of data above the critical threshold [10.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is WARNING **
Notification Type: PROBLEM Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: WARNING Date/Time: Wed 20 Sep 04:46:49 UTC 2017 Additional Info: WARNING: 80.00% of data above the warning threshold [1.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-memc04/Puppet errors is OK **
Notification Type: RECOVERY Service: Puppet errors Host: deployment-memc04 Address: 10.68.23.25 State: OK Date/Time: Tue 19 Sep 16:48:13 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-memc04/Puppet errors is CRITICAL **
Notification Type: PROBLEM Service: Puppet errors Host: deployment-memc04 Address: 10.68.23.25 State: CRITICAL Date/Time: Tue 19 Sep 16:13:12 UTC 2017 Additional Info: CRITICAL: 33.33% of data above the critical threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-kafka01/Free space - all mounts is OK **
Notification Type: RECOVERY Service: Free space - all mounts Host: deployment-kafka01 Address: 10.68.21.219 State: OK Date/Time: Tue 19 Sep 15:58:03 UTC 2017 Additional Info: OK: All targets OK ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-sca01/Puppet errors is OK **
Notification Type: RECOVERY Service: Puppet errors Host: deployment-sca01 Address: 10.68.20.183 State: OK Date/Time: Tue 19 Sep 15:52:24 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-logstash2/Puppet errors is OK **
Notification Type: RECOVERY Service: Puppet errors Host: deployment-logstash2 Address: 10.68.16.147 State: OK Date/Time: Tue 19 Sep 15:52:20 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-memc04/Puppet errors is OK **
Notification Type: RECOVERY Service: Puppet errors Host: deployment-memc04 Address: 10.68.23.25 State: OK Date/Time: Tue 19 Sep 15:52:12 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-puppetmaster02/Long lived cherry-picks on puppetmaster is CRITICAL **
Notification Type: PROBLEM Service: Long lived cherry-picks on puppetmaster Host: deployment-puppetmaster02 Address: 10.68.21.200 State: CRITICAL Date/Time: Tue 19 Sep 15:51:10 UTC 2017 Additional Info: CRITICAL: 100.00% of data above the critical threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-elastic05/Puppet errors is OK **
Notification Type: RECOVERY Service: Puppet errors Host: deployment-elastic05 Address: 10.68.20.21 State: OK Date/Time: Tue 19 Sep 15:51:11 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-kafka04/Puppet errors is OK **
Notification Type: RECOVERY Service: Puppet errors Host: deployment-kafka04 Address: 10.68.17.9 State: OK Date/Time: Tue 19 Sep 15:50:44 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-sentry01/Puppet errors is OK **
Notification Type: RECOVERY Service: Puppet errors Host: deployment-sentry01 Address: 10.68.19.148 State: OK Date/Time: Tue 19 Sep 15:50:37 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-mathoid/Puppet errors is OK **
Notification Type: RECOVERY Service: Puppet errors Host: deployment-mathoid Address: 10.68.23.236 State: OK Date/Time: Tue 19 Sep 15:50:07 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-sca03/Puppet errors is OK **
Notification Type: RECOVERY Service: Puppet errors Host: deployment-sca03 Address: 10.68.21.183 State: OK Date/Time: Tue 19 Sep 15:50:03 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-mcs01/Puppet errors is OK **
Notification Type: RECOVERY Service: Puppet errors Host: deployment-mcs01 Address: 10.68.17.18 State: OK Date/Time: Tue 19 Sep 15:49:47 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-changeprop/Puppet errors is OK **
Notification Type: RECOVERY Service: Puppet errors Host: deployment-changeprop Address: 10.68.16.88 State: OK Date/Time: Tue 19 Sep 15:49:27 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-mx/Puppet errors is OK **
Notification Type: RECOVERY Service: Puppet errors Host: deployment-mx Address: 10.68.17.78 State: OK Date/Time: Tue 19 Sep 15:49:21 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-ms-fe02/Puppet errors is OK **
Notification Type: RECOVERY Service: Puppet errors Host: deployment-ms-fe02 Address: 10.68.19.247 State: OK Date/Time: Tue 19 Sep 15:48:19 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-etcd-01/Puppet errors is OK **
Notification Type: RECOVERY Service: Puppet errors Host: deployment-etcd-01 Address: 10.68.19.227 State: OK Date/Time: Tue 19 Sep 15:47:53 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-db04/Puppet errors is OK **
Notification Type: RECOVERY Service: Puppet errors Host: deployment-db04 Address: 10.68.18.35 State: OK Date/Time: Tue 19 Sep 15:47:39 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-cache-upload04/Puppet errors is OK **
Notification Type: RECOVERY Service: Puppet errors Host: deployment-cache-upload04 Address: 10.68.18.109 State: OK Date/Time: Tue 19 Sep 15:46:06 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-eventlogging04/Puppet errors is OK **
Notification Type: RECOVERY Service: Puppet errors Host: deployment-eventlogging04 Address: 10.68.23.204 State: OK Date/Time: Tue 19 Sep 15:44:30 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-pdf01/Puppet errors is OK **
Notification Type: RECOVERY Service: Puppet errors Host: deployment-pdf01 Address: 10.68.16.73 State: OK Date/Time: Tue 19 Sep 15:44:28 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-memc07/Puppet errors is OK **
Notification Type: RECOVERY Service: Puppet errors Host: deployment-memc07 Address: 10.68.23.111 State: OK Date/Time: Tue 19 Sep 15:44:31 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-eventlog02/Puppet errors is OK **
Notification Type: RECOVERY Service: Puppet errors Host: deployment-eventlog02 Address: 10.68.18.138 State: OK Date/Time: Tue 19 Sep 15:43:44 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-ircd/Puppet errors is OK **
Notification Type: RECOVERY Service: Puppet errors Host: deployment-ircd Address: 10.68.20.19 State: OK Date/Time: Tue 19 Sep 15:43:23 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-conf03/Puppet errors is OK **
Notification Type: RECOVERY Service: Puppet errors Host: deployment-conf03 Address: 10.68.20.134 State: OK Date/Time: Tue 19 Sep 15:43:20 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-tmh01/Puppet errors is OK **
Notification Type: RECOVERY Service: Puppet errors Host: deployment-tmh01 Address: 10.68.16.211 State: OK Date/Time: Tue 19 Sep 15:43:00 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-restbase02/Puppet errors is OK **
Notification Type: RECOVERY Service: Puppet errors Host: deployment-restbase02 Address: 10.68.17.189 State: OK Date/Time: Tue 19 Sep 15:42:48 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-kafka03/Puppet errors is OK **
Notification Type: RECOVERY Service: Puppet errors Host: deployment-kafka03 Address: 10.68.16.138 State: OK Date/Time: Tue 19 Sep 15:42:43 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-imagescaler01/Puppet errors is OK **
Notification Type: RECOVERY Service: Puppet errors Host: deployment-imagescaler01 Address: 10.68.19.158 State: OK Date/Time: Tue 19 Sep 15:42:38 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-memc06/Puppet errors is OK **
Notification Type: RECOVERY Service: Puppet errors Host: deployment-memc06 Address: 10.68.22.239 State: OK Date/Time: Tue 19 Sep 15:42:24 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-db03/Puppet errors is OK **
Notification Type: RECOVERY Service: Puppet errors Host: deployment-db03 Address: 10.68.23.30 State: OK Date/Time: Tue 19 Sep 15:42:23 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-elastic06/Puppet errors is OK **
Notification Type: RECOVERY Service: Puppet errors Host: deployment-elastic06 Address: 10.68.23.242 State: OK Date/Time: Tue 19 Sep 15:40:53 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-redis02/Puppet errors is OK **
Notification Type: RECOVERY Service: Puppet errors Host: deployment-redis02 Address: 10.68.16.231 State: OK Date/Time: Tue 19 Sep 15:40:41 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-kafka-jumbo-1/Puppet errors is OK **
Notification Type: RECOVERY Service: Puppet errors Host: deployment-kafka-jumbo-1 Address: 10.68.23.243 State: OK Date/Time: Tue 19 Sep 15:40:24 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-kafka-jumbo-2/Puppet errors is OK **
Notification Type: RECOVERY Service: Puppet errors Host: deployment-kafka-jumbo-2 Address: 10.68.16.87 State: OK Date/Time: Tue 19 Sep 15:39:57 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-puppetdb01/Puppet errors is OK **
Notification Type: RECOVERY Service: Puppet errors Host: deployment-puppetdb01 Address: 10.68.23.76 State: OK Date/Time: Tue 19 Sep 15:39:47 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-tin/Puppet errors is OK **
Notification Type: RECOVERY Service: Puppet errors Host: deployment-tin Address: 10.68.21.205 State: OK Date/Time: Tue 19 Sep 15:39:26 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-memc05/Puppet errors is OK **
Notification Type: RECOVERY Service: Puppet errors Host: deployment-memc05 Address: 10.68.23.49 State: OK Date/Time: Tue 19 Sep 15:38:33 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-tin/Puppet errors is CRITICAL **
Notification Type: PROBLEM Service: Puppet errors Host: deployment-tin Address: 10.68.21.205 State: CRITICAL Date/Time: Tue 19 Sep 15:04:26 UTC 2017 Additional Info: CRITICAL: 66.67% of data above the critical threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-ms-fe02/Puppet errors is CRITICAL **
Notification Type: PROBLEM Service: Puppet errors Host: deployment-ms-fe02 Address: 10.68.19.247 State: CRITICAL Date/Time: Tue 19 Sep 15:13:19 UTC 2017 Additional Info: CRITICAL: 44.44% of data above the critical threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-eventlogging04/Puppet errors is CRITICAL **
Notification Type: PROBLEM Service: Puppet errors Host: deployment-eventlogging04 Address: 10.68.23.204 State: CRITICAL Date/Time: Tue 19 Sep 15:09:32 UTC 2017 Additional Info: CRITICAL: 66.67% of data above the critical threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-mx/Puppet errors is CRITICAL **
Notification Type: PROBLEM Service: Puppet errors Host: deployment-mx Address: 10.68.17.78 State: CRITICAL Date/Time: Tue 19 Sep 15:14:22 UTC 2017 Additional Info: CRITICAL: 55.56% of data above the critical threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-pdf01/Puppet errors is CRITICAL **
Notification Type: PROBLEM Service: Puppet errors Host: deployment-pdf01 Address: 10.68.16.73 State: CRITICAL Date/Time: Tue 19 Sep 15:09:24 UTC 2017 Additional Info: CRITICAL: 66.67% of data above the critical threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-elastic06/Puppet errors is CRITICAL **
Notification Type: PROBLEM Service: Puppet errors Host: deployment-elastic06 Address: 10.68.23.242 State: CRITICAL Date/Time: Tue 19 Sep 15:05:55 UTC 2017 Additional Info: CRITICAL: 50.00% of data above the critical threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-kafka-jumbo-2/Puppet errors is CRITICAL **
Notification Type: PROBLEM Service: Puppet errors Host: deployment-kafka-jumbo-2 Address: 10.68.16.87 State: CRITICAL Date/Time: Tue 19 Sep 15:04:57 UTC 2017 Additional Info: CRITICAL: 40.00% of data above the critical threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-kafka04/Puppet errors is CRITICAL **
Notification Type: PROBLEM Service: Puppet errors Host: deployment-kafka04 Address: 10.68.17.9 State: CRITICAL Date/Time: Tue 19 Sep 15:10:43 UTC 2017 Additional Info: CRITICAL: 20.00% of data above the critical threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-db04/Puppet errors is CRITICAL **
Notification Type: PROBLEM Service: Puppet errors Host: deployment-db04 Address: 10.68.18.35 State: CRITICAL Date/Time: Tue 19 Sep 15:12:40 UTC 2017 Additional Info: CRITICAL: 22.22% of data above the critical threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-eventlog02/Puppet errors is CRITICAL **
Notification Type: PROBLEM Service: Puppet errors Host: deployment-eventlog02 Address: 10.68.18.138 State: CRITICAL Date/Time: Tue 19 Sep 15:08:44 UTC 2017 Additional Info: CRITICAL: 60.00% of data above the critical threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-etcd-01/Puppet errors is CRITICAL **
Notification Type: PROBLEM Service: Puppet errors Host: deployment-etcd-01 Address: 10.68.19.227 State: CRITICAL Date/Time: Tue 19 Sep 15:12:54 UTC 2017 Additional Info: CRITICAL: 20.00% of data above the critical threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] Host DOWN alert for deployment-stream!
Notification Type: PROBLEM Host: deployment-stream State: DOWN Address: 10.68.17.106 Info: CRITICAL - Host Unreachable (10.68.17.106) Date/Time: Tue 19 Sep 15:06:13 UTC 2017 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-conf03/Puppet errors is CRITICAL **
Notification Type: PROBLEM Service: Puppet errors Host: deployment-conf03 Address: 10.68.20.134 State: CRITICAL Date/Time: Tue 19 Sep 15:08:20 UTC 2017 Additional Info: CRITICAL: 66.67% of data above the critical threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-sentry01/Puppet errors is CRITICAL **
Notification Type: PROBLEM Service: Puppet errors Host: deployment-sentry01 Address: 10.68.19.148 State: CRITICAL Date/Time: Tue 19 Sep 15:10:36 UTC 2017 Additional Info: CRITICAL: 20.00% of data above the critical threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-ircd/Puppet errors is CRITICAL **
Notification Type: PROBLEM Service: Puppet errors Host: deployment-ircd Address: 10.68.20.19 State: CRITICAL Date/Time: Tue 19 Sep 15:08:25 UTC 2017 Additional Info: CRITICAL: 50.00% of data above the critical threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-kafka-jumbo-1/Puppet errors is CRITICAL **
Notification Type: PROBLEM Service: Puppet errors Host: deployment-kafka-jumbo-1 Address: 10.68.23.243 State: CRITICAL Date/Time: Tue 19 Sep 15:05:25 UTC 2017 Additional Info: CRITICAL: 30.00% of data above the critical threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-memc07/Puppet errors is CRITICAL **
Notification Type: PROBLEM Service: Puppet errors Host: deployment-memc07 Address: 10.68.23.111 State: CRITICAL Date/Time: Tue 19 Sep 15:09:32 UTC 2017 Additional Info: CRITICAL: 30.00% of data above the critical threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-db03/Puppet errors is CRITICAL **
Notification Type: PROBLEM Service: Puppet errors Host: deployment-db03 Address: 10.68.23.30 State: CRITICAL Date/Time: Tue 19 Sep 15:07:22 UTC 2017 Additional Info: CRITICAL: 66.67% of data above the critical threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-cache-upload04/Puppet errors is CRITICAL **
Notification Type: PROBLEM Service: Puppet errors Host: deployment-cache-upload04 Address: 10.68.18.109 State: CRITICAL Date/Time: Tue 19 Sep 15:11:06 UTC 2017 Additional Info: CRITICAL: 33.33% of data above the critical threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-sca01/Puppet errors is CRITICAL **
Notification Type: PROBLEM Service: Puppet errors Host: deployment-sca01 Address: 10.68.20.183 State: CRITICAL Date/Time: Tue 19 Sep 15:12:26 UTC 2017 Additional Info: CRITICAL: 20.00% of data above the critical threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-memc05/Puppet errors is CRITICAL **
Notification Type: PROBLEM Service: Puppet errors Host: deployment-memc05 Address: 10.68.23.49 State: CRITICAL Date/Time: Tue 19 Sep 15:03:32 UTC 2017 Additional Info: CRITICAL: 44.44% of data above the critical threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-memc04/Puppet errors is CRITICAL **
Notification Type: PROBLEM Service: Puppet errors Host: deployment-memc04 Address: 10.68.23.25 State: CRITICAL Date/Time: Tue 19 Sep 15:17:15 UTC 2017 Additional Info: CRITICAL: 66.67% of data above the critical threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-sca03/Puppet errors is CRITICAL **
Notification Type: PROBLEM Service: Puppet errors Host: deployment-sca03 Address: 10.68.21.183 State: CRITICAL Date/Time: Tue 19 Sep 15:15:02 UTC 2017 Additional Info: CRITICAL: 33.33% of data above the critical threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-changeprop/Puppet errors is CRITICAL **
Notification Type: PROBLEM Service: Puppet errors Host: deployment-changeprop Address: 10.68.16.88 State: CRITICAL Date/Time: Tue 19 Sep 15:14:27 UTC 2017 Additional Info: CRITICAL: 44.44% of data above the critical threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-elastic05/Puppet errors is CRITICAL **
Notification Type: PROBLEM Service: Puppet errors Host: deployment-elastic05 Address: 10.68.20.21 State: CRITICAL Date/Time: Tue 19 Sep 15:16:10 UTC 2017 Additional Info: CRITICAL: 44.44% of data above the critical threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-mathoid/Puppet errors is CRITICAL **
Notification Type: PROBLEM Service: Puppet errors Host: deployment-mathoid Address: 10.68.23.236 State: CRITICAL Date/Time: Tue 19 Sep 15:15:06 UTC 2017 Additional Info: CRITICAL: 44.44% of data above the critical threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-logstash2/Puppet errors is CRITICAL **
Notification Type: PROBLEM Service: Puppet errors Host: deployment-logstash2 Address: 10.68.16.147 State: CRITICAL Date/Time: Tue 19 Sep 15:17:22 UTC 2017 Additional Info: CRITICAL: 55.56% of data above the critical threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-puppetdb01/Puppet errors is CRITICAL **
Notification Type: PROBLEM Service: Puppet errors Host: deployment-puppetdb01 Address: 10.68.23.76 State: CRITICAL Date/Time: Tue 19 Sep 15:04:46 UTC 2017 Additional Info: CRITICAL: 60.00% of data above the critical threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-mcs01/Puppet errors is CRITICAL **
Notification Type: PROBLEM Service: Puppet errors Host: deployment-mcs01 Address: 10.68.17.18 State: CRITICAL Date/Time: Tue 19 Sep 15:14:45 UTC 2017 Additional Info: CRITICAL: 40.00% of data above the critical threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-tmh01/Puppet errors is CRITICAL **
Notification Type: PROBLEM Service: Puppet errors Host: deployment-tmh01 Address: 10.68.16.211 State: CRITICAL Date/Time: Tue 19 Sep 15:03:00 UTC 2017 Additional Info: CRITICAL: 20.00% of data above the critical threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-restbase02/Puppet errors is CRITICAL **
Notification Type: PROBLEM Service: Puppet errors Host: deployment-restbase02 Address: 10.68.17.189 State: CRITICAL Date/Time: Tue 19 Sep 15:02:49 UTC 2017 Additional Info: CRITICAL: 20.00% of data above the critical threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-kafka03/Puppet errors is CRITICAL **
Notification Type: PROBLEM Service: Puppet errors Host: deployment-kafka03 Address: 10.68.16.138 State: CRITICAL Date/Time: Tue 19 Sep 15:02:44 UTC 2017 Additional Info: CRITICAL: 30.00% of data above the critical threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-memc06/Puppet errors is CRITICAL **
Notification Type: PROBLEM Service: Puppet errors Host: deployment-memc06 Address: 10.68.22.239 State: CRITICAL Date/Time: Tue 19 Sep 15:02:23 UTC 2017 Additional Info: CRITICAL: 20.00% of data above the critical threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-imagescaler01/Puppet errors is CRITICAL **
Notification Type: PROBLEM Service: Puppet errors Host: deployment-imagescaler01 Address: 10.68.19.158 State: CRITICAL Date/Time: Tue 19 Sep 15:02:38 UTC 2017 Additional Info: CRITICAL: 30.00% of data above the critical threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-redis02/Puppet errors is CRITICAL **
Notification Type: PROBLEM Service: Puppet errors Host: deployment-redis02 Address: 10.68.16.231 State: CRITICAL Date/Time: Tue 19 Sep 15:00:41 UTC 2017 Additional Info: CRITICAL: 20.00% of data above the critical threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-stream/Puppet errors is CRITICAL **
Notification Type: PROBLEM Service: Puppet errors Host: deployment-stream Address: 10.68.17.106 State: CRITICAL Date/Time: Tue 19 Sep 14:08:04 UTC 2017 Additional Info: CRITICAL: 55.56% of data above the critical threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - Graphite Labs/Mediawiki Error Rate is OK **
Notification Type: RECOVERY Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: OK Date/Time: Tue 19 Sep 13:55:48 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [1.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is WARNING **
Notification Type: PROBLEM Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: WARNING Date/Time: Tue 19 Sep 13:50:47 UTC 2017 Additional Info: WARNING: 40.00% of data above the warning threshold [1.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - Generic Beta Cluster/English Wikipedia Mobile Main page is OK **
Notification Type: RECOVERY Service: English Wikipedia Mobile Main page Host: Generic Beta Cluster Address: en.wikipedia.beta.wmflabs.org State: OK Date/Time: Tue 19 Sep 13:06:34 UTC 2017 Additional Info: HTTP OK: HTTP/1.1 200 OK - 35599 bytes in 1.884 second response time ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - Generic Beta Cluster/English Wikipedia Mobile Main page is CRITICAL **
Notification Type: PROBLEM Service: English Wikipedia Mobile Main page Host: Generic Beta Cluster Address: en.wikipedia.beta.wmflabs.org State: CRITICAL Date/Time: Tue 19 Sep 13:01:33 UTC 2017 Additional Info: HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'Wikipedia' not found on 'https://en.m.wikipedia.beta.wmflabs.org:443/wiki/Main_Page?debug=true' - 1971 bytes in 3.128 second response time ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-kafka-jumbo-1/Puppet errors is OK **
Notification Type: RECOVERY Service: Puppet errors Host: deployment-kafka-jumbo-1 Address: 10.68.23.243 State: OK Date/Time: Tue 19 Sep 12:44:24 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-kafka-jumbo-2/Puppet errors is OK **
Notification Type: RECOVERY Service: Puppet errors Host: deployment-kafka-jumbo-2 Address: 10.68.16.87 State: OK Date/Time: Tue 19 Sep 12:23:55 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-kafka-jumbo-1/Puppet errors is CRITICAL **
Notification Type: PROBLEM Service: Puppet errors Host: deployment-kafka-jumbo-1 Address: 10.68.23.243 State: CRITICAL Date/Time: Tue 19 Sep 12:04:24 UTC 2017 Additional Info: CRITICAL: 40.00% of data above the critical threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-kafka-jumbo-2/Puppet errors is CRITICAL **
Notification Type: PROBLEM Service: Puppet errors Host: deployment-kafka-jumbo-2 Address: 10.68.16.87 State: CRITICAL Date/Time: Tue 19 Sep 12:03:56 UTC 2017 Additional Info: CRITICAL: 50.00% of data above the critical threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-trending01/Puppet errors is CRITICAL **
Notification Type: PROBLEM Service: Puppet errors Host: deployment-trending01 Address: 10.68.18.186 State: CRITICAL Date/Time: Tue 19 Sep 09:02:01 UTC 2017 Additional Info: CRITICAL: 30.00% of data above the critical threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - Graphite Labs/Mediawiki Error Rate is OK **
Notification Type: RECOVERY Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: OK Date/Time: Tue 19 Sep 08:54:48 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [1.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
