[Betacluster-alerts] Host UP alert for beta-cluster!

2018-06-08 Thread shinken
Notification Type: RECOVERY Host: beta-cluster State: UP Address: en.wikipedia.beta.wmflabs.org Info: PING OK - Packet loss = 0%, RTA = 2.24 ms Date/Time: Sat 09 Jun 03:23:50 UTC 2018 ___ Betacluster-alerts mailing list

[Betacluster-alerts] Host DOWN alert for beta-cluster!

2018-06-08 Thread shinken
Notification Type: PROBLEM Host: beta-cluster State: DOWN Address: en.wikipedia.beta.wmflabs.org Info: check_ping: Invalid hostname/address - en.wikipedia.beta.wmflabs.org Date/Time: Sat 09 Jun 03:17:17 UTC 2018 ___ Betacluster-alerts mailing list

[Betacluster-alerts] Host UP alert for beta-cluster!

2018-06-08 Thread shinken
Notification Type: RECOVERY Host: beta-cluster State: UP Address: en.wikipedia.beta.wmflabs.org Info: PING OK - Packet loss = 0%, RTA = 3.62 ms Date/Time: Sat 09 Jun 03:13:51 UTC 2018 ___ Betacluster-alerts mailing list

[Betacluster-alerts] Host DOWN alert for beta-cluster!

2018-06-08 Thread shinken
Notification Type: PROBLEM Host: beta-cluster State: DOWN Address: en.wikipedia.beta.wmflabs.org Info: check_ping: Invalid hostname/address - en.wikipedia.beta.wmflabs.org Date/Time: Sat 09 Jun 03:08:49 UTC 2018 ___ Betacluster-alerts mailing list

[Betacluster-alerts] ** PROBLEM alert - Generic Beta Cluster/English Wikipedia Mobile Main page is CRITICAL **

2018-06-08 Thread shinken
Notification Type: PROBLEM Service: English Wikipedia Mobile Main page Host: Generic Beta Cluster Address: en.wikipedia.beta.wmflabs.org State: CRITICAL Date/Time: Sat 09 Jun 03:06:14 UTC 2018 Notes URLs: Additional Info: Name or service not known

[Betacluster-alerts] Host DOWN alert for deployment-puppetmaster02!

2018-06-08 Thread shinken
Notification Type: PROBLEM Host: deployment-puppetmaster02 State: DOWN Address: 10.68.21.200 Info: CRITICAL - Host Unreachable (10.68.21.200) Date/Time: Sat 09 Jun 02:24:19 UTC 2018 ___ Betacluster-alerts mailing list

[Betacluster-alerts] Host DOWN alert for deployment-redis01!

2018-06-08 Thread shinken
Notification Type: PROBLEM Host: deployment-redis01 State: DOWN Address: 10.68.16.177 Info: CRITICAL - Host Unreachable (10.68.16.177) Date/Time: Sat 09 Jun 02:15:50 UTC 2018 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] Host DOWN alert for deployment-redis02!

2018-06-08 Thread shinken
Notification Type: PROBLEM Host: deployment-redis02 State: DOWN Address: 10.68.16.231 Info: CRITICAL - Host Unreachable (10.68.16.231) Date/Time: Sat 09 Jun 02:15:47 UTC 2018 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] Host UP alert for beta-cluster!

2018-06-08 Thread shinken
Notification Type: RECOVERY Host: beta-cluster State: UP Address: en.wikipedia.beta.wmflabs.org Info: PING OK - Packet loss = 0%, RTA = 2.70 ms Date/Time: Sat 09 Jun 02:03:52 UTC 2018 ___ Betacluster-alerts mailing list

[Betacluster-alerts] Host DOWN alert for beta-cluster!

2018-06-08 Thread shinken
Notification Type: PROBLEM Host: beta-cluster State: DOWN Address: en.wikipedia.beta.wmflabs.org Info: check_ping: Invalid hostname/address - en.wikipedia.beta.wmflabs.org Date/Time: Sat 09 Jun 01:57:27 UTC 2018 ___ Betacluster-alerts mailing list

[Betacluster-alerts] ** PROBLEM alert - Generic Beta Cluster/English Wikipedia Mobile Main page is CRITICAL **

2018-06-08 Thread shinken
Notification Type: PROBLEM Service: English Wikipedia Mobile Main page Host: Generic Beta Cluster Address: en.wikipedia.beta.wmflabs.org State: CRITICAL Date/Time: Sat 09 Jun 01:55:13 UTC 2018 Notes URLs: Additional Info: Name or service not known

[Betacluster-alerts] ** PROBLEM alert - deployment-puppetmaster02/Long lived cherry-picks on puppetmaster is CRITICAL **

2018-06-08 Thread shinken
Notification Type: PROBLEM Service: Long lived cherry-picks on puppetmaster Host: deployment-puppetmaster02 Address: 10.68.21.200 State: CRITICAL Date/Time: Sat 09 Jun 00:31:16 UTC 2018 Notes URLs: Additional Info: CRITICAL: 100.00% of data above the critical threshold [0.0]

[Betacluster-alerts] ** RECOVERY alert - deployment-sentry01/Puppet errors is OK **

2018-06-08 Thread shinken
Notification Type: RECOVERY Service: Puppet errors Host: deployment-sentry01 Address: 10.68.19.148 State: OK Date/Time: Sat 09 Jun 00:26:45 UTC 2018 Notes URLs: Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts

[Betacluster-alerts] ** RECOVERY alert - deployment-webperf11/Puppet errors is OK **

2018-06-08 Thread shinken
Notification Type: RECOVERY Service: Puppet errors Host: deployment-webperf11 Address: 10.68.19.168 State: OK Date/Time: Sat 09 Jun 00:19:04 UTC 2018 Notes URLs: Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts

[Betacluster-alerts] ** RECOVERY alert - deployment-eventlog05/Puppet errors is OK **

2018-06-08 Thread shinken
Notification Type: RECOVERY Service: Puppet errors Host: deployment-eventlog05 Address: 10.68.18.180 State: OK Date/Time: Sat 09 Jun 00:17:45 UTC 2018 Notes URLs: Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts

[Betacluster-alerts] ** RECOVERY alert - deployment-kafka-main-1/Puppet errors is OK **

2018-06-08 Thread shinken
Notification Type: RECOVERY Service: Puppet errors Host: deployment-kafka-main-1 Address: 10.68.18.219 State: OK Date/Time: Sat 09 Jun 00:12:28 UTC 2018 Notes URLs: Additional Info: OK: Less than 1.00% above the threshold [0.0] ___

[Betacluster-alerts] ** RECOVERY alert - deployment-kafka-main-2/Puppet errors is OK **

2018-06-08 Thread shinken
Notification Type: RECOVERY Service: Puppet errors Host: deployment-kafka-main-2 Address: 10.68.23.182 State: OK Date/Time: Sat 09 Jun 00:11:55 UTC 2018 Notes URLs: Additional Info: OK: Less than 1.00% above the threshold [0.0] ___

[Betacluster-alerts] beta-code-update-eqiad - Build # 208591 - Fixed!

2018-06-08 Thread jenkins-bot
beta-code-update-eqiad - Build # 208591 - Fixed: Check console output at https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/208591/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] ** PROBLEM alert - deployment-sentry01/Puppet errors is CRITICAL **

2018-06-08 Thread shinken
Notification Type: PROBLEM Service: Puppet errors Host: deployment-sentry01 Address: 10.68.19.148 State: CRITICAL Date/Time: Fri 08 Jun 23:16:43 UTC 2018 Notes URLs: Additional Info: CRITICAL: 30.00% of data above the critical threshold [0.0] ___

[Betacluster-alerts] ** PROBLEM alert - deployment-webperf11/Puppet errors is CRITICAL **

2018-06-08 Thread shinken
Notification Type: PROBLEM Service: Puppet errors Host: deployment-webperf11 Address: 10.68.19.168 State: CRITICAL Date/Time: Fri 08 Jun 23:09:03 UTC 2018 Notes URLs: Additional Info: CRITICAL: 33.33% of data above the critical threshold [0.0] ___

[Betacluster-alerts] ** PROBLEM alert - deployment-eventlog05/Puppet errors is CRITICAL **

2018-06-08 Thread shinken
Notification Type: PROBLEM Service: Puppet errors Host: deployment-eventlog05 Address: 10.68.18.180 State: CRITICAL Date/Time: Fri 08 Jun 23:07:47 UTC 2018 Notes URLs: Additional Info: CRITICAL: 33.33% of data above the critical threshold [0.0] ___

[Betacluster-alerts] ** PROBLEM alert - deployment-kafka-main-1/Puppet errors is CRITICAL **

2018-06-08 Thread shinken
Notification Type: PROBLEM Service: Puppet errors Host: deployment-kafka-main-1 Address: 10.68.18.219 State: CRITICAL Date/Time: Fri 08 Jun 23:02:29 UTC 2018 Notes URLs: Additional Info: CRITICAL: 22.22% of data above the critical threshold [0.0]

[Betacluster-alerts] beta-code-update-eqiad - Build # 208585 - Failure!

2018-06-08 Thread jenkins-bot
beta-code-update-eqiad - Build # 208585 - Failure: Check console output at https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/208585/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] ** PROBLEM alert - deployment-puppetmaster02/Puppet staleness is WARNING **

2018-06-08 Thread shinken
Notification Type: PROBLEM Service: Puppet staleness Host: deployment-puppetmaster02 Address: 10.68.21.200 State: WARNING Date/Time: Fri 08 Jun 21:55:58 UTC 2018 Notes URLs: Additional Info: WARNING: 40.00% of data above the warning threshold [3600.0]

[Betacluster-alerts] ** RECOVERY alert - deployment-mediawiki06/Free space - all mounts is OK **

2018-06-08 Thread shinken
Notification Type: RECOVERY Service: Free space - all mounts Host: deployment-mediawiki06 Address: 10.68.19.241 State: OK Date/Time: Fri 08 Jun 20:43:59 UTC 2018 Notes URLs: Additional Info: OK: All targets OK ___ Betacluster-alerts mailing list

[Betacluster-alerts] ** PROBLEM alert - deployment-mediawiki06/Free space - all mounts is WARNING **

2018-06-08 Thread shinken
Notification Type: PROBLEM Service: Free space - all mounts Host: deployment-mediawiki06 Address: 10.68.19.241 State: WARNING Date/Time: Fri 08 Jun 20:38:59 UTC 2018 Notes URLs: Additional Info: WARNING: deployment-prep.deployment-mediawiki06.diskspace.root.byte_percentfree (<11.11%)

[Betacluster-alerts] ** PROBLEM alert - deployment-mx/Puppet errors is CRITICAL **

2018-06-08 Thread shinken
Notification Type: PROBLEM Service: Puppet errors Host: deployment-mx Address: 10.68.17.78 State: CRITICAL Date/Time: Fri 08 Jun 18:39:21 UTC 2018 Notes URLs: Additional Info: CRITICAL: 100.00% of data above the critical threshold [0.0] ___

[Betacluster-alerts] ** RECOVERY alert - deployment-sentry01/Puppet errors is OK **

2018-06-08 Thread shinken
Notification Type: RECOVERY Service: Puppet errors Host: deployment-sentry01 Address: 10.68.19.148 State: OK Date/Time: Fri 08 Jun 17:55:46 UTC 2018 Notes URLs: Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts

[Betacluster-alerts] beta-code-update-eqiad - Build # 208558 - Fixed!

2018-06-08 Thread jenkins-bot
beta-code-update-eqiad - Build # 208558 - Fixed: Check console output at https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/208558/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] ** PROBLEM alert - deployment-sentry01/Puppet errors is CRITICAL **

2018-06-08 Thread shinken
Notification Type: PROBLEM Service: Puppet errors Host: deployment-sentry01 Address: 10.68.19.148 State: CRITICAL Date/Time: Fri 08 Jun 17:15:46 UTC 2018 Notes URLs: Additional Info: CRITICAL: 20.00% of data above the critical threshold [0.0] ___

[Betacluster-alerts] beta-code-update-eqiad - Build # 208557 - Failure!

2018-06-08 Thread jenkins-bot
beta-code-update-eqiad - Build # 208557 - Failure: Check console output at https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/208557/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] ** PROBLEM alert - deployment-redis02/Puppet errors is CRITICAL **

2018-06-08 Thread shinken
Notification Type: PROBLEM Service: Puppet errors Host: deployment-redis02 Address: 10.68.16.231 State: CRITICAL Date/Time: Fri 08 Jun 15:33:41 UTC 2018 Notes URLs: Additional Info: CRITICAL: 100.00% of data above the critical threshold [0.0] ___

[Betacluster-alerts] ** PROBLEM alert - deployment-redis01/Puppet errors is CRITICAL **

2018-06-08 Thread shinken
Notification Type: PROBLEM Service: Puppet errors Host: deployment-redis01 Address: 10.68.16.177 State: CRITICAL Date/Time: Fri 08 Jun 15:27:43 UTC 2018 Notes URLs: Additional Info: CRITICAL: 100.00% of data above the critical threshold [0.0] ___

[Betacluster-alerts] ** RECOVERY alert - deployment-tin/Free space - all mounts is OK **

2018-06-08 Thread shinken
Notification Type: RECOVERY Service: Free space - all mounts Host: deployment-tin Address: 10.68.21.205 State: OK Date/Time: Fri 08 Jun 11:00:10 UTC 2018 Notes URLs: Additional Info: OK: deployment-prep.deployment-tin.diskspace._mnt.byte_percentfree (No valid datapoints found)

[Betacluster-alerts] ** PROBLEM alert - deployment-sca02/Citoid is WARNING **

2018-06-08 Thread shinken
Notification Type: PROBLEM Service: Citoid Host: deployment-sca02 Address: 10.68.20.153 State: WARNING Date/Time: Fri 08 Jun 10:12:54 UTC 2018 Notes URLs: Additional Info: HTTP WARNING: HTTP/1.1 404 Not Found - 825 bytes in 0.017 second response time

[Betacluster-alerts] ** PROBLEM alert - deployment-sca01/Citoid is WARNING **

2018-06-08 Thread shinken
Notification Type: PROBLEM Service: Citoid Host: deployment-sca01 Address: 10.68.20.183 State: WARNING Date/Time: Fri 08 Jun 10:09:33 UTC 2018 Notes URLs: Additional Info: HTTP WARNING: HTTP/1.1 404 Not Found - 825 bytes in 0.013 second response time

[Betacluster-alerts] ** RECOVERY alert - Graphite Labs/Mediawiki Error Rate is OK **

2018-06-08 Thread shinken
Notification Type: RECOVERY Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: OK Date/Time: Fri 08 Jun 09:28:46 UTC 2018 Notes URLs: Additional Info: OK: Less than 1.00% above the threshold [1.0] ___

[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is WARNING **

2018-06-08 Thread shinken
Notification Type: PROBLEM Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: WARNING Date/Time: Fri 08 Jun 09:23:45 UTC 2018 Notes URLs: Additional Info: WARNING: 20.00% of data above the warning threshold [1.0]

[Betacluster-alerts] ** RECOVERY alert - deployment-mediawiki06/Free space - all mounts is OK **

2018-06-08 Thread shinken
Notification Type: RECOVERY Service: Free space - all mounts Host: deployment-mediawiki06 Address: 10.68.19.241 State: OK Date/Time: Fri 08 Jun 08:38:01 UTC 2018 Notes URLs: Additional Info: OK: All targets OK ___ Betacluster-alerts mailing list

[Betacluster-alerts] ** PROBLEM alert - deployment-tin/Free space - all mounts is WARNING **

2018-06-08 Thread shinken
Notification Type: PROBLEM Service: Free space - all mounts Host: deployment-tin Address: 10.68.21.205 State: WARNING Date/Time: Fri 08 Jun 08:35:10 UTC 2018 Notes URLs: Additional Info: WARNING: deployment-prep.deployment-tin.diskspace._mnt.byte_percentfree (No valid datapoints

[Betacluster-alerts] ** PROBLEM alert - deployment-mediawiki06/Free space - all mounts is WARNING **

2018-06-08 Thread shinken
Notification Type: PROBLEM Service: Free space - all mounts Host: deployment-mediawiki06 Address: 10.68.19.241 State: WARNING Date/Time: Fri 08 Jun 08:27:59 UTC 2018 Notes URLs: Additional Info: WARNING: deployment-prep.deployment-mediawiki06.diskspace.root.byte_percentfree (<11.11%)

[Betacluster-alerts] ** RECOVERY alert - deployment-tin/Free space - all mounts is OK **

2018-06-08 Thread shinken
Notification Type: RECOVERY Service: Free space - all mounts Host: deployment-tin Address: 10.68.21.205 State: OK Date/Time: Fri 08 Jun 07:54:11 UTC 2018 Notes URLs: Additional Info: OK: deployment-prep.deployment-tin.diskspace._mnt.byte_percentfree (No valid datapoints found)

[Betacluster-alerts] ** PROBLEM alert - deployment-tin/Free space - all mounts is WARNING **

2018-06-08 Thread shinken
Notification Type: PROBLEM Service: Free space - all mounts Host: deployment-tin Address: 10.68.21.205 State: WARNING Date/Time: Fri 08 Jun 07:49:10 UTC 2018 Notes URLs: Additional Info: WARNING: deployment-prep.deployment-tin.diskspace._mnt.byte_percentfree (No valid datapoints

[Betacluster-alerts] ** RECOVERY alert - deployment-conf03/Puppet errors is OK **

2018-06-08 Thread shinken
Notification Type: RECOVERY Service: Puppet errors Host: deployment-conf03 Address: 10.68.20.134 State: OK Date/Time: Fri 08 Jun 07:08:12 UTC 2018 Notes URLs: Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts

[Betacluster-alerts] ** PROBLEM alert - deployment-mediawiki-07/Free space - all mounts is WARNING **

2018-06-08 Thread shinken
Notification Type: PROBLEM Service: Free space - all mounts Host: deployment-mediawiki-07 Address: 10.68.18.62 State: WARNING Date/Time: Fri 08 Jun 07:02:19 UTC 2018 Notes URLs: Additional Info: WARNING: deployment-prep.deployment-mediawiki-07.diskspace.root.byte_percentfree (<100.00%)

[Betacluster-alerts] ** RECOVERY alert - deployment-fluorine02/Free space - all mounts is OK **

2018-06-08 Thread shinken
Notification Type: RECOVERY Service: Free space - all mounts Host: deployment-fluorine02 Address: 10.68.23.106 State: OK Date/Time: Fri 08 Jun 06:47:09 UTC 2018 Notes URLs: Additional Info: OK: All targets OK ___ Betacluster-alerts mailing list

[Betacluster-alerts] ** PROBLEM alert - deployment-conf03/Puppet errors is CRITICAL **

2018-06-08 Thread shinken
Notification Type: PROBLEM Service: Puppet errors Host: deployment-conf03 Address: 10.68.20.134 State: CRITICAL Date/Time: Fri 08 Jun 06:28:11 UTC 2018 Notes URLs: Additional Info: CRITICAL: 33.33% of data above the critical threshold [0.0] ___