[Betacluster-alerts] ** PROBLEM alert - deployment-fluorine02/Free space - all mounts is CRITICAL **

Notification Type: PROBLEM Service: Free space - all mounts Host: deployment-fluorine02 Address: 10.68.23.106 State: CRITICAL Date/Time: Thu 22 Jun 05:25:39 UTC 2017 Additional Info: CRITICAL: deployment-prep.deployment-fluorine02.diskspace._srv.byte_percentfree (<10.00%)

[Betacluster-alerts] beta-scap-eqiad - Build # 160755 - Fixed!

beta-scap-eqiad - Build # 160755 - Fixed: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/160755/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] beta-scap-eqiad - Build # 160754 - Failure!

beta-scap-eqiad - Build # 160754 - Failure: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/160754/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] beta-scap-eqiad - Build # 160751 - Fixed!

beta-scap-eqiad - Build # 160751 - Fixed: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/160751/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] ** PROBLEM alert - deployment-fluorine02/Free space - all mounts is WARNING **

Notification Type: PROBLEM Service: Free space - all mounts Host: deployment-fluorine02 Address: 10.68.23.106 State: WARNING Date/Time: Thu 22 Jun 02:20:39 UTC 2017 Additional Info: WARNING: deployment-prep.deployment-fluorine02.diskspace._srv.byte_percentfree (<60.00%)

[Betacluster-alerts] beta-scap-eqiad - Build # 160735 - Failure!

beta-scap-eqiad - Build # 160735 - Failure: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/160735/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] beta-scap-eqiad - Build # 160714 - Fixed!

beta-scap-eqiad - Build # 160714 - Fixed: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/160714/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] ** RECOVERY alert - deployment-pdfrender02/Puppet errors is OK **

Notification Type: RECOVERY Service: Puppet errors Host: deployment-pdfrender02 Address: 10.68.21.240 State: OK Date/Time: Wed 21 Jun 22:24:21 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list

[Betacluster-alerts] beta-scap-eqiad - Build # 160713 - Failure!

beta-scap-eqiad - Build # 160713 - Failure: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/160713/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] ** PROBLEM alert - deployment-pdfrender02/Puppet errors is CRITICAL **

Notification Type: PROBLEM Service: Puppet errors Host: deployment-pdfrender02 Address: 10.68.21.240 State: CRITICAL Date/Time: Wed 21 Jun 21:49:24 UTC 2017 Additional Info: CRITICAL: 55.56% of data above the critical threshold [0.0] ___

[Betacluster-alerts] ** RECOVERY alert - deployment-tin/Free space - all mounts is OK **

Notification Type: RECOVERY Service: Free space - all mounts Host: deployment-tin Address: 10.68.21.205 State: OK Date/Time: Wed 21 Jun 21:36:03 UTC 2017 Additional Info: OK: deployment-prep.deployment-tin.diskspace._mnt.byte_percentfree (No valid datapoints found)

[Betacluster-alerts] ** PROBLEM alert - deployment-tin/Free space - all mounts is WARNING **

Notification Type: PROBLEM Service: Free space - all mounts Host: deployment-tin Address: 10.68.21.205 State: WARNING Date/Time: Wed 21 Jun 21:26:04 UTC 2017 Additional Info: WARNING: deployment-prep.deployment-tin.diskspace._mnt.byte_percentfree (No valid datapoints

[Betacluster-alerts] ** RECOVERY alert - deployment-kafka01/Free space - all mounts is OK **

Notification Type: RECOVERY Service: Free space - all mounts Host: deployment-kafka01 Address: 10.68.21.219 State: OK Date/Time: Wed 21 Jun 20:59:39 UTC 2017 Additional Info: OK: All targets OK ___ Betacluster-alerts mailing list

[Betacluster-alerts] ** PROBLEM alert - deployment-kafka01/Puppet staleness is WARNING **

Notification Type: PROBLEM Service: Puppet staleness Host: deployment-kafka01 Address: 10.68.21.219 State: WARNING Date/Time: Wed 21 Jun 20:55:58 UTC 2017 Additional Info: WARNING: 60.00% of data above the warning threshold [3600.0] ___

[Betacluster-alerts] ** RECOVERY alert - deployment-db04/Puppet errors is OK **

Notification Type: RECOVERY Service: Puppet errors Host: deployment-db04 Address: 10.68.18.35 State: OK Date/Time: Wed 21 Jun 20:07:22 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list

[Betacluster-alerts] beta-scap-eqiad - Build # 160699 - Fixed!

beta-scap-eqiad - Build # 160699 - Fixed: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/160699/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] beta-scap-eqiad - Build # 160698 - Still Failing!

beta-scap-eqiad - Build # 160698 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/160698/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] beta-scap-eqiad - Build # 160697 - Still Failing!

beta-scap-eqiad - Build # 160697 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/160697/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] beta-scap-eqiad - Build # 160696 - Still Failing!

beta-scap-eqiad - Build # 160696 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/160696/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] ** RECOVERY alert - deployment-tin/Puppet errors is OK **

Notification Type: RECOVERY Service: Puppet errors Host: deployment-tin Address: 10.68.21.205 State: OK Date/Time: Wed 21 Jun 19:42:55 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list

[Betacluster-alerts] ** RECOVERY alert - deployment-trending01/Puppet errors is OK **

Notification Type: RECOVERY Service: Puppet errors Host: deployment-trending01 Address: 10.68.18.186 State: OK Date/Time: Wed 21 Jun 19:42:48 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list

[Betacluster-alerts] ** RECOVERY alert - deployment-tmh01/Puppet errors is OK **

Notification Type: RECOVERY Service: Puppet errors Host: deployment-tmh01 Address: 10.68.16.211 State: OK Date/Time: Wed 21 Jun 19:42:24 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list

[Betacluster-alerts] ** RECOVERY alert - deployment-restbase02/Puppet errors is OK **

Notification Type: RECOVERY Service: Puppet errors Host: deployment-restbase02 Address: 10.68.17.189 State: OK Date/Time: Wed 21 Jun 19:42:09 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list

[Betacluster-alerts] ** RECOVERY alert - deployment-redis02/Puppet errors is OK **

Notification Type: RECOVERY Service: Puppet errors Host: deployment-redis02 Address: 10.68.16.231 State: OK Date/Time: Wed 21 Jun 19:42:22 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list

[Betacluster-alerts] ** RECOVERY alert - deployment-eventlogging04/Puppet errors is OK **

Notification Type: RECOVERY Service: Puppet errors Host: deployment-eventlogging04 Address: 10.68.23.204 State: OK Date/Time: Wed 21 Jun 19:41:49 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing

[Betacluster-alerts] ** RECOVERY alert - deployment-memc05/Puppet errors is OK **

Notification Type: RECOVERY Service: Puppet errors Host: deployment-memc05 Address: 10.68.23.49 State: OK Date/Time: Wed 21 Jun 19:40:52 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list

[Betacluster-alerts] ** RECOVERY alert - deployment-puppetdb01/Puppet errors is OK **

Notification Type: RECOVERY Service: Puppet errors Host: deployment-puppetdb01 Address: 10.68.23.76 State: OK Date/Time: Wed 21 Jun 19:39:48 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list

[Betacluster-alerts] ** PROBLEM alert - deployment-mediawiki04/App Server Main HTTP Response is CRITICAL **

Notification Type: PROBLEM Service: App Server Main HTTP Response Host: deployment-mediawiki04 Address: 10.68.19.128 State: CRITICAL Date/Time: Wed 21 Jun 19:35:49 UTC 2017 Additional Info: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - 1592 bytes in 0.050 second response time

[Betacluster-alerts] beta-scap-eqiad - Build # 160695 - Still Failing!

beta-scap-eqiad - Build # 160695 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/160695/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] ** PROBLEM alert - deployment-elastic06/Puppet errors is CRITICAL **

Notification Type: PROBLEM Service: Puppet errors Host: deployment-elastic06 Address: 10.68.23.242 State: CRITICAL Date/Time: Wed 21 Jun 19:33:49 UTC 2017 Additional Info: CRITICAL: 40.00% of data above the critical threshold [0.0] ___

[Betacluster-alerts] ** PROBLEM alert - deployment-imagescaler01/Puppet errors is CRITICAL **

Notification Type: PROBLEM Service: Puppet errors Host: deployment-imagescaler01 Address: 10.68.19.158 State: CRITICAL Date/Time: Wed 21 Jun 19:31:55 UTC 2017 Additional Info: CRITICAL: 100.00% of data above the critical threshold [0.0] ___

[Betacluster-alerts] ** RECOVERY alert - Graphite Labs/Mediawiki Error Rate is OK **

Notification Type: RECOVERY Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: OK Date/Time: Wed 21 Jun 19:30:11 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [1.0] ___ Betacluster-alerts

[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is WARNING **

Notification Type: PROBLEM Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: WARNING Date/Time: Wed 21 Jun 19:25:10 UTC 2017 Additional Info: WARNING: 20.00% of data above the warning threshold [1.0] ___

[Betacluster-alerts] beta-scap-eqiad - Build # 160694 - Still Failing!

beta-scap-eqiad - Build # 160694 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/160694/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] ** RECOVERY alert - deployment-elastic06/Puppet errors is OK **

Notification Type: RECOVERY Service: Puppet errors Host: deployment-elastic06 Address: 10.68.23.242 State: OK Date/Time: Wed 21 Jun 19:22:48 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list

[Betacluster-alerts] ** RECOVERY alert - deployment-sca03/Puppet errors is OK **

Notification Type: RECOVERY Service: Puppet errors Host: deployment-sca03 Address: 10.68.21.183 State: OK Date/Time: Wed 21 Jun 19:19:34 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list

[Betacluster-alerts] ** RECOVERY alert - deployment-sca01/Puppet errors is OK **

Notification Type: RECOVERY Service: Puppet errors Host: deployment-sca01 Address: 10.68.20.183 State: OK Date/Time: Wed 21 Jun 19:19:10 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list

[Betacluster-alerts] ** PROBLEM alert - deployment-logstash2/Puppet errors is CRITICAL **

Notification Type: PROBLEM Service: Puppet errors Host: deployment-logstash2 Address: 10.68.16.147 State: CRITICAL Date/Time: Wed 21 Jun 19:17:24 UTC 2017 Additional Info: CRITICAL: 66.67% of data above the critical threshold [0.0] ___

[Betacluster-alerts] ** RECOVERY alert - deployment-changeprop/Puppet errors is OK **

Notification Type: RECOVERY Service: Puppet errors Host: deployment-changeprop Address: 10.68.16.88 State: OK Date/Time: Wed 21 Jun 19:15:19 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list

[Betacluster-alerts] ** RECOVERY alert - deployment-sca02/Puppet errors is OK **

Notification Type: RECOVERY Service: Puppet errors Host: deployment-sca02 Address: 10.68.20.153 State: OK Date/Time: Wed 21 Jun 19:14:58 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list

[Betacluster-alerts] ** RECOVERY alert - deployment-stream/Puppet errors is OK **

Notification Type: RECOVERY Service: Puppet errors Host: deployment-stream Address: 10.68.17.106 State: OK Date/Time: Wed 21 Jun 19:14:59 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list

[Betacluster-alerts] beta-scap-eqiad - Build # 160693 - Still Failing!

beta-scap-eqiad - Build # 160693 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/160693/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] ** RECOVERY alert - deployment-aqs02/Puppet errors is OK **

Notification Type: RECOVERY Service: Puppet errors Host: deployment-aqs02 Address: 10.68.17.90 State: OK Date/Time: Wed 21 Jun 19:14:39 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list

[Betacluster-alerts] ** PROBLEM alert - deployment-db03/Puppet errors is CRITICAL **

Notification Type: PROBLEM Service: Puppet errors Host: deployment-db03 Address: 10.68.23.30 State: CRITICAL Date/Time: Wed 21 Jun 19:14:33 UTC 2017 Additional Info: CRITICAL: 100.00% of data above the critical threshold [0.0] ___ Betacluster-alerts

[Betacluster-alerts] ** RECOVERY alert - deployment-elastic07/Puppet errors is OK **

Notification Type: RECOVERY Service: Puppet errors Host: deployment-elastic07 Address: 10.68.19.180 State: OK Date/Time: Wed 21 Jun 19:14:29 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list

[Betacluster-alerts] ** RECOVERY alert - deployment-ms-fe02/Puppet errors is OK **

Notification Type: RECOVERY Service: Puppet errors Host: deployment-ms-fe02 Address: 10.68.19.247 State: OK Date/Time: Wed 21 Jun 19:14:14 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list

[Betacluster-alerts] ** RECOVERY alert - deployment-salt02/Puppet errors is OK **

Notification Type: RECOVERY Service: Puppet errors Host: deployment-salt02 Address: 10.68.17.58 State: OK Date/Time: Wed 21 Jun 19:13:49 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list

[Betacluster-alerts] ** RECOVERY alert - deployment-aqs03/Puppet errors is OK **

Notification Type: RECOVERY Service: Puppet errors Host: deployment-aqs03 Address: 10.68.17.125 State: OK Date/Time: Wed 21 Jun 19:14:14 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list

[Betacluster-alerts] beta-code-update-eqiad - Build # 160795 - Fixed!

beta-code-update-eqiad - Build # 160795 - Fixed: Check console output at https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/160795/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] ** RECOVERY alert - deployment-pdfrender02/Puppet errors is OK **

Notification Type: RECOVERY Service: Puppet errors Host: deployment-pdfrender02 Address: 10.68.21.240 State: OK Date/Time: Wed 21 Jun 19:13:22 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list

[Betacluster-alerts] ** RECOVERY alert - deployment-mx/Puppet errors is OK **

Notification Type: RECOVERY Service: Puppet errors Host: deployment-mx Address: 10.68.17.78 State: OK Date/Time: Wed 21 Jun 19:13:15 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list

[Betacluster-alerts] ** PROBLEM alert - deployment-ircd/Puppet errors is CRITICAL **

Notification Type: PROBLEM Service: Puppet errors Host: deployment-ircd Address: 10.68.20.19 State: CRITICAL Date/Time: Wed 21 Jun 19:13:09 UTC 2017 Additional Info: CRITICAL: 100.00% of data above the critical threshold [0.0] ___ Betacluster-alerts

[Betacluster-alerts] ** RECOVERY alert - deployment-mathoid/Puppet errors is OK **

Notification Type: RECOVERY Service: Puppet errors Host: deployment-mathoid Address: 10.68.23.236 State: OK Date/Time: Wed 21 Jun 19:12:07 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list

[Betacluster-alerts] ** PROBLEM alert - deployment-trending01/Puppet errors is CRITICAL **

Notification Type: PROBLEM Service: Puppet errors Host: deployment-trending01 Address: 10.68.18.186 State: CRITICAL Date/Time: Wed 21 Jun 19:12:47 UTC 2017 Additional Info: CRITICAL: 100.00% of data above the critical threshold [0.0] ___

[Betacluster-alerts] ** RECOVERY alert - deployment-kafka01/Puppet errors is OK **

Notification Type: RECOVERY Service: Puppet errors Host: deployment-kafka01 Address: 10.68.21.219 State: OK Date/Time: Wed 21 Jun 19:12:50 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list

[Betacluster-alerts] ** PROBLEM alert - deployment-tin/Puppet errors is CRITICAL **

Notification Type: PROBLEM Service: Puppet errors Host: deployment-tin Address: 10.68.21.205 State: CRITICAL Date/Time: Wed 21 Jun 19:12:54 UTC 2017 Additional Info: CRITICAL: 100.00% of data above the critical threshold [0.0] ___ Betacluster-alerts

[Betacluster-alerts] ** RECOVERY alert - deployment-sca04/Puppet errors is OK **

Notification Type: RECOVERY Service: Puppet errors Host: deployment-sca04 Address: 10.68.18.80 State: OK Date/Time: Wed 21 Jun 19:12:46 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list

[Betacluster-alerts] ** RECOVERY alert - deployment-sentry01/Puppet errors is OK **

Notification Type: RECOVERY Service: Puppet errors Host: deployment-sentry01 Address: 10.68.19.148 State: OK Date/Time: Wed 21 Jun 19:12:09 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list

[Betacluster-alerts] ** PROBLEM alert - deployment-redis02/Puppet errors is CRITICAL **

Notification Type: PROBLEM Service: Puppet errors Host: deployment-redis02 Address: 10.68.16.231 State: CRITICAL Date/Time: Wed 21 Jun 19:12:19 UTC 2017 Additional Info: CRITICAL: 100.00% of data above the critical threshold [0.0] ___

[Betacluster-alerts] ** PROBLEM alert - deployment-tmh01/Puppet errors is CRITICAL **

Notification Type: PROBLEM Service: Puppet errors Host: deployment-tmh01 Address: 10.68.16.211 State: CRITICAL Date/Time: Wed 21 Jun 19:12:25 UTC 2017 Additional Info: CRITICAL: 100.00% of data above the critical threshold [0.0] ___

[Betacluster-alerts] ** RECOVERY alert - deployment-mediawiki04/Puppet errors is OK **

Notification Type: RECOVERY Service: Puppet errors Host: deployment-mediawiki04 Address: 10.68.19.128 State: OK Date/Time: Wed 21 Jun 19:12:23 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list

[Betacluster-alerts] ** RECOVERY alert - deployment-mediawiki05/Puppet errors is OK **

Notification Type: RECOVERY Service: Puppet errors Host: deployment-mediawiki05 Address: 10.68.22.21 State: OK Date/Time: Wed 21 Jun 19:12:23 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list

[Betacluster-alerts] ** RECOVERY alert - deployment-cache-upload04/Puppet errors is OK **

Notification Type: RECOVERY Service: Puppet errors Host: deployment-cache-upload04 Address: 10.68.18.109 State: OK Date/Time: Wed 21 Jun 19:12:13 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing

[Betacluster-alerts] ** PROBLEM alert - deployment-restbase02/Puppet errors is CRITICAL **

Notification Type: PROBLEM Service: Puppet errors Host: deployment-restbase02 Address: 10.68.17.189 State: CRITICAL Date/Time: Wed 21 Jun 19:12:08 UTC 2017 Additional Info: CRITICAL: 100.00% of data above the critical threshold [0.0] ___

[Betacluster-alerts] ** RECOVERY alert - deployment-kafka04/Puppet errors is OK **

Notification Type: RECOVERY Service: Puppet errors Host: deployment-kafka04 Address: 10.68.17.9 State: OK Date/Time: Wed 21 Jun 19:12:02 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list

[Betacluster-alerts] ** RECOVERY alert - deployment-mcs01/Puppet errors is OK **

Notification Type: RECOVERY Service: Puppet errors Host: deployment-mcs01 Address: 10.68.17.18 State: OK Date/Time: Wed 21 Jun 19:11:44 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list

[Betacluster-alerts] ** PROBLEM alert - deployment-eventlogging04/Puppet errors is CRITICAL **

Notification Type: PROBLEM Service: Puppet errors Host: deployment-eventlogging04 Address: 10.68.23.204 State: CRITICAL Date/Time: Wed 21 Jun 19:11:49 UTC 2017 Additional Info: CRITICAL: 100.00% of data above the critical threshold [0.0] ___

[Betacluster-alerts] ** RECOVERY alert - deployment-elastic05/Puppet errors is OK **

Notification Type: RECOVERY Service: Puppet errors Host: deployment-elastic05 Address: 10.68.20.21 State: OK Date/Time: Wed 21 Jun 19:11:44 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list

[Betacluster-alerts] ** RECOVERY alert - deployment-zotero01/Puppet errors is OK **

Notification Type: RECOVERY Service: Puppet errors Host: deployment-zotero01 Address: 10.68.17.102 State: OK Date/Time: Wed 21 Jun 19:11:25 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list

[Betacluster-alerts] ** RECOVERY alert - deployment-logstash2/Puppet errors is OK **

Notification Type: RECOVERY Service: Puppet errors Host: deployment-logstash2 Address: 10.68.16.147 State: OK Date/Time: Wed 21 Jun 19:11:26 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list

[Betacluster-alerts] ** PROBLEM alert - deployment-memc05/Puppet errors is CRITICAL **

Notification Type: PROBLEM Service: Puppet errors Host: deployment-memc05 Address: 10.68.23.49 State: CRITICAL Date/Time: Wed 21 Jun 19:10:49 UTC 2017 Additional Info: CRITICAL: 100.00% of data above the critical threshold [0.0] ___

[Betacluster-alerts] ** RECOVERY alert - deployment-zookeeper02/Puppet errors is OK **

Notification Type: RECOVERY Service: Puppet errors Host: deployment-zookeeper02 Address: 10.68.18.75 State: OK Date/Time: Wed 21 Jun 19:11:03 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list

[Betacluster-alerts] ** RECOVERY alert - deployment-ms-be03/Puppet errors is OK **

Notification Type: RECOVERY Service: Puppet errors Host: deployment-ms-be03 Address: 10.68.22.125 State: OK Date/Time: Wed 21 Jun 19:10:08 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list

[Betacluster-alerts] ** RECOVERY alert - deployment-eventlogging03/Puppet errors is OK **

Notification Type: RECOVERY Service: Puppet errors Host: deployment-eventlogging03 Address: 10.68.18.111 State: OK Date/Time: Wed 21 Jun 19:10:30 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing

[Betacluster-alerts] ** RECOVERY alert - deployment-mediawiki06/App Server Main HTTP Response is OK **

Notification Type: RECOVERY Service: App Server Main HTTP Response Host: deployment-mediawiki06 Address: 10.68.19.241 State: OK Date/Time: Wed 21 Jun 19:09:37 UTC 2017 Additional Info: HTTP OK: HTTP/1.1 200 OK - 44552 bytes in 1.379 second response time

[Betacluster-alerts] ** RECOVERY alert - deployment-kafka01/Free space - all mounts is OK **

Notification Type: RECOVERY Service: Free space - all mounts Host: deployment-kafka01 Address: 10.68.21.219 State: OK Date/Time: Wed 21 Jun 19:08:39 UTC 2017 Additional Info: OK: deployment-prep.deployment-kafka01.diskspace.root.byte_percentfree (More than half of the datapoints are

[Betacluster-alerts] ** RECOVERY alert - Generic Beta Cluster/English Wikipedia Main page is OK **

Notification Type: RECOVERY Service: English Wikipedia Main page Host: Generic Beta Cluster Address: en.wikipedia.beta.wmflabs.org State: OK Date/Time: Wed 21 Jun 19:07:59 UTC 2017 Additional Info: HTTP OK: HTTP/1.1 200 OK - 45146 bytes in 1.072 second response time

[Betacluster-alerts] Host UP alert for deployment-db03!

Notification Type: RECOVERY Host: deployment-db03 State: UP Address: 10.68.23.30 Info: PING OK - Packet loss = 0%, RTA = 1.75 ms Date/Time: Wed 21 Jun 19:06:49 UTC 2017 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] Host UP alert for deployment-db04!

Notification Type: RECOVERY Host: deployment-db04 State: UP Address: 10.68.18.35 Info: PING OK - Packet loss = 0%, RTA = 0.84 ms Date/Time: Wed 21 Jun 19:05:46 UTC 2017 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] Host UP alert for graphite-labs!

Notification Type: RECOVERY Host: graphite-labs State: UP Address: graphite-labs.wikimedia.org Info: PING OK - Packet loss = 0%, RTA = 0.43 ms Date/Time: Wed 21 Jun 19:04:24 UTC 2017 ___ Betacluster-alerts mailing list

[Betacluster-alerts] ** PROBLEM alert - Generic Beta Cluster/English Wikipedia Main page is CRITICAL **

Notification Type: PROBLEM Service: English Wikipedia Main page Host: Generic Beta Cluster Address: en.wikipedia.beta.wmflabs.org State: CRITICAL Date/Time: Wed 21 Jun 18:57:58 UTC 2017 Additional Info: Name or service not known ___

[Betacluster-alerts] Host DOWN alert for deployment-db04!

Notification Type: PROBLEM Host: deployment-db04 State: DOWN Address: 10.68.18.35 Info: CRITICAL - Host Unreachable (10.68.18.35) Date/Time: Wed 21 Jun 18:57:27 UTC 2017 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] Host DOWN alert for graphite-labs!

Notification Type: PROBLEM Host: graphite-labs State: DOWN Address: graphite-labs.wikimedia.org Info: CRITICAL - Host Unreachable (graphite-labs.wikimedia.org) Date/Time: Wed 21 Jun 18:59:15 UTC 2017 ___ Betacluster-alerts mailing list

[Betacluster-alerts] ** PROBLEM alert - deployment-mediawiki06/App Server Main HTTP Response is CRITICAL **

Notification Type: PROBLEM Service: App Server Main HTTP Response Host: deployment-mediawiki06 Address: 10.68.19.241 State: CRITICAL Date/Time: Wed 21 Jun 18:59:39 UTC 2017 Additional Info: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - 1594 bytes in 2.639 second response time

[Betacluster-alerts] Host DOWN alert for deployment-db03!

Notification Type: PROBLEM Host: deployment-db03 State: DOWN Address: 10.68.23.30 Info: CRITICAL - Host Unreachable (10.68.23.30) Date/Time: Wed 21 Jun 18:59:11 UTC 2017 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] beta-code-update-eqiad - Build # 160794 - Failure!

beta-code-update-eqiad - Build # 160794 - Failure: Check console output at https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/160794/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] Host UP alert for beta-cluster!

Notification Type: RECOVERY Host: beta-cluster State: UP Address: en.wikipedia.beta.wmflabs.org Info: PING OK - Packet loss = 0%, RTA = 1.35 ms Date/Time: Wed 21 Jun 19:03:04 UTC 2017 ___ Betacluster-alerts mailing list

[Betacluster-alerts] ** PROBLEM alert - deployment-mediawiki05/App Server Main HTTP Response is CRITICAL **

Notification Type: PROBLEM Service: App Server Main HTTP Response Host: deployment-mediawiki05 Address: 10.68.22.21 State: CRITICAL Date/Time: Wed 21 Jun 19:01:40 UTC 2017 Additional Info: CRITICAL - Socket timeout after 10 seconds ___

[Betacluster-alerts] Host DOWN alert for beta-cluster!

Notification Type: PROBLEM Host: beta-cluster State: DOWN Address: en.wikipedia.beta.wmflabs.org Info: (Host Check Timed Out) Date/Time: Wed 21 Jun 19:00:54 UTC 2017 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] beta-scap-eqiad - Build # 160692 - Still Failing!

beta-scap-eqiad - Build # 160692 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/160692/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] beta-scap-eqiad - Build # 160691 - Still Failing!

beta-scap-eqiad - Build # 160691 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/160691/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] beta-scap-eqiad - Build # 160690 - Still Failing!

beta-scap-eqiad - Build # 160690 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/160690/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] beta-scap-eqiad - Build # 160689 - Still Failing!

beta-scap-eqiad - Build # 160689 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/160689/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] ** PROBLEM alert - deployment-kafka01/Puppet errors is CRITICAL **

Notification Type: PROBLEM Service: Puppet errors Host: deployment-kafka01 Address: 10.68.21.219 State: CRITICAL Date/Time: Wed 21 Jun 18:27:49 UTC 2017 Additional Info: CRITICAL: 10.00% of data above the critical threshold [0.0] ___

[Betacluster-alerts] beta-scap-eqiad - Build # 160688 - Still Failing!

beta-scap-eqiad - Build # 160688 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/160688/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] ** PROBLEM alert - deployment-mediawiki05/Puppet errors is CRITICAL **

Notification Type: PROBLEM Service: Puppet errors Host: deployment-mediawiki05 Address: 10.68.22.21 State: CRITICAL Date/Time: Wed 21 Jun 18:22:22 UTC 2017 Additional Info: CRITICAL: 66.67% of data above the critical threshold [0.0] ___

[Betacluster-alerts] ** PROBLEM alert - deployment-zookeeper02/Puppet errors is CRITICAL **

Notification Type: PROBLEM Service: Puppet errors Host: deployment-zookeeper02 Address: 10.68.18.75 State: CRITICAL Date/Time: Wed 21 Jun 18:21:02 UTC 2017 Additional Info: CRITICAL: 33.33% of data above the critical threshold [0.0] ___

[Betacluster-alerts] ** PROBLEM alert - deployment-puppetmaster02/Puppet errors is CRITICAL **

Notification Type: PROBLEM Service: Puppet errors Host: deployment-puppetmaster02 Address: 10.68.21.200 State: CRITICAL Date/Time: Wed 21 Jun 18:21:12 UTC 2017 Additional Info: CRITICAL: 55.56% of data above the critical threshold [0.0] ___

[Betacluster-alerts] ** PROBLEM alert - deployment-fluorine02/Puppet errors is CRITICAL **

Notification Type: PROBLEM Service: Puppet errors Host: deployment-fluorine02 Address: 10.68.23.106 State: CRITICAL Date/Time: Wed 21 Jun 18:20:49 UTC 2017 Additional Info: CRITICAL: 40.00% of data above the critical threshold [0.0] ___

[Betacluster-alerts] ** PROBLEM alert - deployment-kafka05/Puppet errors is CRITICAL **

Notification Type: PROBLEM Service: Puppet errors Host: deployment-kafka05 Address: 10.68.21.106 State: CRITICAL Date/Time: Wed 21 Jun 18:20:11 UTC 2017 Additional Info: CRITICAL: 44.44% of data above the critical threshold [0.0] ___

  1   2   3   4   5   6   >