[Betacluster-alerts] Host DOWN alert for deployment-puppetmaster02!

Notification Type: PROBLEM Host: deployment-puppetmaster02 State: DOWN Address: 10.68.21.200 Info: CRITICAL - Host Unreachable (10.68.21.200) Date/Time: Sat 23 Jun 02:24:19 UTC 2018 ___ Betacluster-alerts mailing list

[Betacluster-alerts] Host DOWN alert for deployment-dumps-puppetmaster!

Notification Type: PROBLEM Host: deployment-dumps-puppetmaster State: DOWN Address: 10.68.21.153 Info: CRITICAL - Host Unreachable (10.68.21.153) Date/Time: Sat 23 Jun 02:18:00 UTC 2018 ___ Betacluster-alerts mailing list

[Betacluster-alerts] Host DOWN alert for deployment-redis01!

Notification Type: PROBLEM Host: deployment-redis01 State: DOWN Address: 10.68.16.177 Info: CRITICAL - Host Unreachable (10.68.16.177) Date/Time: Sat 23 Jun 02:15:50 UTC 2018 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] Host DOWN alert for deployment-redis02!

Notification Type: PROBLEM Host: deployment-redis02 State: DOWN Address: 10.68.16.231 Info: CRITICAL - Host Unreachable (10.68.16.231) Date/Time: Sat 23 Jun 02:15:47 UTC 2018 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] ** RECOVERY alert - deployment-elastic05/Puppet errors is OK **

Notification Type: RECOVERY Service: Puppet errors Host: deployment-elastic05 Address: 10.68.20.21 State: OK Date/Time: Fri 22 Jun 22:49:50 UTC 2018 Notes URLs: Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts

[Betacluster-alerts] ** RECOVERY alert - deployment-kafka-jumbo-1/Free space - all mounts is OK **

Notification Type: RECOVERY Service: Free space - all mounts Host: deployment-kafka-jumbo-1 Address: 10.68.23.243 State: OK Date/Time: Fri 22 Jun 22:29:20 UTC 2018 Notes URLs: Additional Info: OK: All targets OK ___ Betacluster-alerts mailing list

[Betacluster-alerts] ** PROBLEM alert - deployment-elastic05/Puppet errors is CRITICAL **

Notification Type: PROBLEM Service: Puppet errors Host: deployment-elastic05 Address: 10.68.20.21 State: CRITICAL Date/Time: Fri 22 Jun 22:09:48 UTC 2018 Notes URLs: Additional Info: CRITICAL: 40.00% of data above the critical threshold [0.0] ___

[Betacluster-alerts] ** PROBLEM alert - deployment-kafka-jumbo-1/Free space - all mounts is WARNING **

Notification Type: PROBLEM Service: Free space - all mounts Host: deployment-kafka-jumbo-1 Address: 10.68.23.243 State: WARNING Date/Time: Fri 22 Jun 22:09:19 UTC 2018 Notes URLs: Additional Info: WARNING: deployment-prep.deployment-kafka-jumbo-1.diskspace.root.byte_percentfree (<44.44%)

[Betacluster-alerts] ** RECOVERY alert - deployment-mediawiki-07/Free space - all mounts is OK **

Notification Type: RECOVERY Service: Free space - all mounts Host: deployment-mediawiki-07 Address: 10.68.18.62 State: OK Date/Time: Fri 22 Jun 21:49:34 UTC 2018 Notes URLs: Additional Info: OK: All targets OK ___ Betacluster-alerts mailing list

[Betacluster-alerts] ** RECOVERY alert - deployment-kafka-jumbo-1/Free space - all mounts is OK **

Notification Type: RECOVERY Service: Free space - all mounts Host: deployment-kafka-jumbo-1 Address: 10.68.23.243 State: OK Date/Time: Fri 22 Jun 21:48:21 UTC 2018 Notes URLs: Additional Info: OK: All targets OK ___ Betacluster-alerts mailing list

[Betacluster-alerts] ** RECOVERY alert - deployment-kafka-jumbo-2/Free space - all mounts is OK **

Notification Type: RECOVERY Service: Free space - all mounts Host: deployment-kafka-jumbo-2 Address: 10.68.16.87 State: OK Date/Time: Fri 22 Jun 21:31:39 UTC 2018 Notes URLs: Additional Info: OK: All targets OK ___ Betacluster-alerts mailing list

[Betacluster-alerts] ** PROBLEM alert - deployment-kafka-jumbo-2/Free space - all mounts is WARNING **

Notification Type: PROBLEM Service: Free space - all mounts Host: deployment-kafka-jumbo-2 Address: 10.68.16.87 State: WARNING Date/Time: Fri 22 Jun 20:56:40 UTC 2018 Notes URLs: Additional Info: WARNING: deployment-prep.deployment-kafka-jumbo-2.diskspace.root.byte_percentfree (<50.00%)

[Betacluster-alerts] ** RECOVERY alert - deployment-mediawiki06/Free space - all mounts is OK **

Notification Type: RECOVERY Service: Free space - all mounts Host: deployment-mediawiki06 Address: 10.68.19.241 State: OK Date/Time: Fri 22 Jun 20:55:59 UTC 2018 Notes URLs: Additional Info: OK: All targets OK ___ Betacluster-alerts mailing list

[Betacluster-alerts] ** PROBLEM alert - deployment-mediawiki06/Free space - all mounts is WARNING **

Notification Type: PROBLEM Service: Free space - all mounts Host: deployment-mediawiki06 Address: 10.68.19.241 State: WARNING Date/Time: Fri 22 Jun 20:50:59 UTC 2018 Notes URLs: Additional Info: WARNING: deployment-prep.deployment-mediawiki06.diskspace.root.byte_percentfree (<11.11%)

[Betacluster-alerts] ** RECOVERY alert - deployment-kafka-jumbo-2/Free space - all mounts is OK **

Notification Type: RECOVERY Service: Free space - all mounts Host: deployment-kafka-jumbo-2 Address: 10.68.16.87 State: OK Date/Time: Fri 22 Jun 20:50:40 UTC 2018 Notes URLs: Additional Info: OK: All targets OK ___ Betacluster-alerts mailing list

[Betacluster-alerts] ** RECOVERY alert - Graphite Labs/Mediawiki Error Rate is OK **

Notification Type: RECOVERY Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: OK Date/Time: Fri 22 Jun 20:13:45 UTC 2018 Notes URLs: Additional Info: OK: Less than 1.00% above the threshold [1.0] ___

[Betacluster-alerts] ** RECOVERY alert - deployment-mediawiki06/Free space - all mounts is OK **

Notification Type: RECOVERY Service: Free space - all mounts Host: deployment-mediawiki06 Address: 10.68.19.241 State: OK Date/Time: Fri 22 Jun 20:10:00 UTC 2018 Notes URLs: Additional Info: OK: All targets OK ___ Betacluster-alerts mailing list

[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is WARNING **

Notification Type: PROBLEM Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: WARNING Date/Time: Fri 22 Jun 20:08:47 UTC 2018 Notes URLs: Additional Info: WARNING: 20.00% of data above the warning threshold [1.0]

[Betacluster-alerts] ** PROBLEM alert - deployment-tin/Free space - all mounts is WARNING **

Notification Type: PROBLEM Service: Free space - all mounts Host: deployment-tin Address: 10.68.21.205 State: WARNING Date/Time: Fri 22 Jun 20:07:10 UTC 2018 Notes URLs: Additional Info: WARNING: deployment-prep.deployment-tin.diskspace._mnt.byte_percentfree (No valid datapoints

[Betacluster-alerts] ** PROBLEM alert - deployment-mediawiki06/Free space - all mounts is WARNING **

Notification Type: PROBLEM Service: Free space - all mounts Host: deployment-mediawiki06 Address: 10.68.19.241 State: WARNING Date/Time: Fri 22 Jun 20:04:59 UTC 2018 Notes URLs: Additional Info: WARNING: deployment-prep.deployment-mediawiki06.diskspace.root.byte_percentfree (<11.11%)

[Betacluster-alerts] ** PROBLEM alert - deployment-kafka-jumbo-2/Free space - all mounts is WARNING **

Notification Type: PROBLEM Service: Free space - all mounts Host: deployment-kafka-jumbo-2 Address: 10.68.16.87 State: WARNING Date/Time: Fri 22 Jun 20:00:41 UTC 2018 Notes URLs: Additional Info: WARNING: deployment-prep.deployment-kafka-jumbo-2.diskspace.root.byte_percentfree (<50.00%)

[Betacluster-alerts] ** PROBLEM alert - deployment-kafka-jumbo-1/Free space - all mounts is WARNING **

Notification Type: PROBLEM Service: Free space - all mounts Host: deployment-kafka-jumbo-1 Address: 10.68.23.243 State: WARNING Date/Time: Fri 22 Jun 19:08:20 UTC 2018 Notes URLs: Additional Info: WARNING: deployment-prep.deployment-kafka-jumbo-1.diskspace.root.byte_percentfree (<66.67%)

[Betacluster-alerts] ** RECOVERY alert - deployment-kafka-jumbo-1/Free space - all mounts is OK **

Notification Type: RECOVERY Service: Free space - all mounts Host: deployment-kafka-jumbo-1 Address: 10.68.23.243 State: OK Date/Time: Fri 22 Jun 18:47:19 UTC 2018 Notes URLs: Additional Info: OK: All targets OK ___ Betacluster-alerts mailing list

[Betacluster-alerts] ** PROBLEM alert - deployment-kafka-jumbo-1/Free space - all mounts is WARNING **

Notification Type: PROBLEM Service: Free space - all mounts Host: deployment-kafka-jumbo-1 Address: 10.68.23.243 State: WARNING Date/Time: Fri 22 Jun 18:07:18 UTC 2018 Notes URLs: Additional Info: WARNING: deployment-prep.deployment-kafka-jumbo-1.diskspace.root.byte_percentfree (<55.56%)

[Betacluster-alerts] ** RECOVERY alert - deployment-tin/Free space - all mounts is OK **

Notification Type: RECOVERY Service: Free space - all mounts Host: deployment-tin Address: 10.68.21.205 State: OK Date/Time: Fri 22 Jun 16:41:12 UTC 2018 Notes URLs: Additional Info: OK: deployment-prep.deployment-tin.diskspace._mnt.byte_percentfree (No valid datapoints found)

[Betacluster-alerts] ** RECOVERY alert - Graphite Labs/Mediawiki Error Rate is OK **

Notification Type: RECOVERY Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: OK Date/Time: Fri 22 Jun 15:57:47 UTC 2018 Notes URLs: Additional Info: OK: Less than 1.00% above the threshold [1.0] ___

[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is WARNING **

Notification Type: PROBLEM Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: WARNING Date/Time: Fri 22 Jun 15:52:49 UTC 2018 Notes URLs: Additional Info: WARNING: 20.00% of data above the warning threshold [1.0]

[Betacluster-alerts] ** RECOVERY alert - deployment-kafka-jumbo-2/Free space - all mounts is OK **

Notification Type: RECOVERY Service: Free space - all mounts Host: deployment-kafka-jumbo-2 Address: 10.68.16.87 State: OK Date/Time: Fri 22 Jun 13:49:39 UTC 2018 Notes URLs: Additional Info: OK: All targets OK ___ Betacluster-alerts mailing list

[Betacluster-alerts] ** RECOVERY alert - deployment-kafka-jumbo-1/Free space - all mounts is OK **

Notification Type: RECOVERY Service: Free space - all mounts Host: deployment-kafka-jumbo-1 Address: 10.68.23.243 State: OK Date/Time: Fri 22 Jun 13:36:20 UTC 2018 Notes URLs: Additional Info: OK: All targets OK ___ Betacluster-alerts mailing list

[Betacluster-alerts] ** PROBLEM alert - deployment-kafka-jumbo-1/Free space - all mounts is WARNING **

Notification Type: PROBLEM Service: Free space - all mounts Host: deployment-kafka-jumbo-1 Address: 10.68.23.243 State: WARNING Date/Time: Fri 22 Jun 13:16:19 UTC 2018 Notes URLs: Additional Info: WARNING: deployment-prep.deployment-kafka-jumbo-1.diskspace.root.byte_percentfree (<100.00%)

[Betacluster-alerts] ** PROBLEM alert - deployment-kafka-jumbo-1/Free space - all mounts is CRITICAL **

Notification Type: PROBLEM Service: Free space - all mounts Host: deployment-kafka-jumbo-1 Address: 10.68.23.243 State: CRITICAL Date/Time: Fri 22 Jun 12:16:19 UTC 2018 Notes URLs: Additional Info: CRITICAL: deployment-prep.deployment-kafka-jumbo-1.diskspace.root.byte_percentfree (<22.22%)

[Betacluster-alerts] ** PROBLEM alert - deployment-sca02/Citoid is WARNING **

Notification Type: PROBLEM Service: Citoid Host: deployment-sca02 Address: 10.68.20.153 State: WARNING Date/Time: Fri 22 Jun 10:12:54 UTC 2018 Notes URLs: Additional Info: HTTP WARNING: HTTP/1.1 404 Not Found - 825 bytes in 0.011 second response time

[Betacluster-alerts] ** PROBLEM alert - deployment-sca01/Citoid is WARNING **

Notification Type: PROBLEM Service: Citoid Host: deployment-sca01 Address: 10.68.20.183 State: WARNING Date/Time: Fri 22 Jun 10:09:33 UTC 2018 Notes URLs: Additional Info: HTTP WARNING: HTTP/1.1 404 Not Found - 825 bytes in 0.011 second response time

[Betacluster-alerts] ** PROBLEM alert - deployment-tin/Free space - all mounts is WARNING **

Notification Type: PROBLEM Service: Free space - all mounts Host: deployment-tin Address: 10.68.21.205 State: WARNING Date/Time: Fri 22 Jun 08:41:10 UTC 2018 Notes URLs: Additional Info: WARNING: deployment-prep.deployment-tin.diskspace._mnt.byte_percentfree (No valid datapoints

[Betacluster-alerts] ** PROBLEM alert - deployment-mediawiki-07/Free space - all mounts is WARNING **

Notification Type: PROBLEM Service: Free space - all mounts Host: deployment-mediawiki-07 Address: 10.68.18.62 State: WARNING Date/Time: Fri 22 Jun 07:02:19 UTC 2018 Notes URLs: Additional Info: WARNING: deployment-prep.deployment-mediawiki-07.diskspace.root.byte_percentfree (<100.00%)