[Betacluster-alerts] ** RECOVERY alert - Graphite Labs/Mediawiki Error Rate is OK **

2017-12-20 Thread shinken
Notification Type: RECOVERY Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: OK Date/Time: Thu 21 Dec 06:58:36 UTC 2017 Notes URLs: Additional Info: OK: Less than 1.00% above the threshold [1.0] ___

[Betacluster-alerts] ** PROBLEM alert - deployment-secureredirexperiment/Puppet staleness is CRITICAL **

2017-12-20 Thread shinken
Notification Type: PROBLEM Service: Puppet staleness Host: deployment-secureredirexperiment Address: 10.68.17.132 State: CRITICAL Date/Time: Thu 21 Dec 06:51:48 UTC 2017 Notes URLs: Additional Info: CRITICAL: 100.00% of data above the critical threshold [43200.0]

[Betacluster-alerts] ** PROBLEM alert - deployment-ms-be04/Puppet staleness is CRITICAL **

2017-12-20 Thread shinken
Notification Type: PROBLEM Service: Puppet staleness Host: deployment-ms-be04 Address: 10.68.16.139 State: CRITICAL Date/Time: Thu 21 Dec 06:49:25 UTC 2017 Notes URLs: Additional Info: CRITICAL: 100.00% of data above the critical threshold [43200.0]

[Betacluster-alerts] ** PROBLEM alert - deployment-eventlog02/Free space - all mounts is WARNING **

2017-12-20 Thread shinken
Notification Type: PROBLEM Service: Free space - all mounts Host: deployment-eventlog02 Address: 10.68.18.138 State: WARNING Date/Time: Thu 21 Dec 06:47:12 UTC 2017 Notes URLs: Additional Info: WARNING: deployment-prep.deployment-eventlog02.diskspace.root.byte_percentfree (<100.00%)

[Betacluster-alerts] ** PROBLEM alert - deployment-ms-be03/Puppet staleness is CRITICAL **

2017-12-20 Thread shinken
Notification Type: PROBLEM Service: Puppet staleness Host: deployment-ms-be03 Address: 10.68.22.125 State: CRITICAL Date/Time: Thu 21 Dec 06:44:37 UTC 2017 Notes URLs: Additional Info: CRITICAL: 100.00% of data above the critical threshold [43200.0]

[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is WARNING **

2017-12-20 Thread shinken
Notification Type: PROBLEM Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: WARNING Date/Time: Thu 21 Dec 06:28:37 UTC 2017 Notes URLs: Additional Info: WARNING: 80.00% of data above the warning threshold [1.0]

[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is CRITICAL **

2017-12-20 Thread shinken
Notification Type: PROBLEM Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: CRITICAL Date/Time: Thu 21 Dec 06:23:39 UTC 2017 Notes URLs: Additional Info: CRITICAL: 20.00% of data above the critical threshold [10.0]

[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is WARNING **

2017-12-20 Thread shinken
Notification Type: PROBLEM Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: WARNING Date/Time: Thu 21 Dec 05:43:38 UTC 2017 Notes URLs: Additional Info: WARNING: 80.00% of data above the warning threshold [1.0]

[Betacluster-alerts] ** PROBLEM alert - deployment-restbase01/Puppet staleness is CRITICAL **

2017-12-20 Thread shinken
Notification Type: PROBLEM Service: Puppet staleness Host: deployment-restbase01 Address: 10.68.16.128 State: CRITICAL Date/Time: Thu 21 Dec 04:59:27 UTC 2017 Notes URLs: Additional Info: CRITICAL: 100.00% of data above the critical threshold [43200.0]

[Betacluster-alerts] ** PROBLEM alert - deployment-tin/Puppet errors is CRITICAL **

2017-12-20 Thread shinken
Notification Type: PROBLEM Service: Puppet errors Host: deployment-tin Address: 10.68.21.205 State: CRITICAL Date/Time: Thu 21 Dec 02:49:20 UTC 2017 Notes URLs: Additional Info: CRITICAL: 100.00% of data above the critical threshold [0.0] ___

[Betacluster-alerts] ** PROBLEM alert - deployment-mira/Puppet errors is CRITICAL **

2017-12-20 Thread shinken
Notification Type: PROBLEM Service: Puppet errors Host: deployment-mira Address: 10.68.20.135 State: CRITICAL Date/Time: Thu 21 Dec 02:43:29 UTC 2017 Notes URLs: Additional Info: CRITICAL: 100.00% of data above the critical threshold [0.0] ___

[Betacluster-alerts] ** PROBLEM alert - deployment-puppetmaster02/Long lived cherry-picks on puppetmaster is CRITICAL **

2017-12-20 Thread shinken
Notification Type: PROBLEM Service: Long lived cherry-picks on puppetmaster Host: deployment-puppetmaster02 Address: 10.68.21.200 State: CRITICAL Date/Time: Thu 21 Dec 02:30:44 UTC 2017 Notes URLs: Additional Info: CRITICAL: 100.00% of data above the critical threshold [0.0]

[Betacluster-alerts] ** PROBLEM alert - deployment-kafka-jumbo-1/Puppet errors is CRITICAL **

2017-12-20 Thread shinken
Notification Type: PROBLEM Service: Puppet errors Host: deployment-kafka-jumbo-1 Address: 10.68.23.243 State: CRITICAL Date/Time: Wed 20 Dec 23:37:24 UTC 2017 Notes URLs: Additional Info: CRITICAL: 100.00% of data above the critical threshold [0.0]

[Betacluster-alerts] ** PROBLEM alert - deployment-kafka-jumbo-2/Puppet errors is CRITICAL **

2017-12-20 Thread shinken
Notification Type: PROBLEM Service: Puppet errors Host: deployment-kafka-jumbo-2 Address: 10.68.16.87 State: CRITICAL Date/Time: Wed 20 Dec 23:30:56 UTC 2017 Notes URLs: Additional Info: CRITICAL: 100.00% of data above the critical threshold [0.0]

[Betacluster-alerts] ** PROBLEM alert - deployment-kafka03/Free space - all mounts is CRITICAL **

2017-12-20 Thread shinken
Notification Type: PROBLEM Service: Free space - all mounts Host: deployment-kafka03 Address: 10.68.16.138 State: CRITICAL Date/Time: Wed 20 Dec 23:15:28 UTC 2017 Notes URLs: Additional Info: CRITICAL: deployment-prep.deployment-kafka03.diskspace.root.byte_percentfree (<33.33%)

[Betacluster-alerts] ** PROBLEM alert - deployment-eventlog02/Free space - all mounts is CRITICAL **

2017-12-20 Thread shinken
Notification Type: PROBLEM Service: Free space - all mounts Host: deployment-eventlog02 Address: 10.68.18.138 State: CRITICAL Date/Time: Wed 20 Dec 22:52:12 UTC 2017 Notes URLs: Additional Info: CRITICAL: deployment-prep.deployment-eventlog02.diskspace.root.byte_percentfree (<11.11%)

[Betacluster-alerts] ** PROBLEM alert - deployment-kafka03/Free space - all mounts is WARNING **

2017-12-20 Thread shinken
Notification Type: PROBLEM Service: Free space - all mounts Host: deployment-kafka03 Address: 10.68.16.138 State: WARNING Date/Time: Wed 20 Dec 22:35:27 UTC 2017 Notes URLs: Additional Info: WARNING: deployment-prep.deployment-kafka03.diskspace.root.byte_percentfree (<100.00%)

[Betacluster-alerts] ** PROBLEM alert - deployment-etcd-01/Puppet errors is CRITICAL **

2017-12-20 Thread shinken
Notification Type: PROBLEM Service: Puppet errors Host: deployment-etcd-01 Address: 10.68.19.227 State: CRITICAL Date/Time: Wed 20 Dec 22:35:42 UTC 2017 Notes URLs: Additional Info: CRITICAL: 100.00% of data above the critical threshold [0.0] ___

[Betacluster-alerts] ** PROBLEM alert - deployment-sentry01/Puppet errors is CRITICAL **

2017-12-20 Thread shinken
Notification Type: PROBLEM Service: Puppet errors Host: deployment-sentry01 Address: 10.68.19.148 State: CRITICAL Date/Time: Wed 20 Dec 22:20:13 UTC 2017 Notes URLs: Additional Info: CRITICAL: 100.00% of data above the critical threshold [0.0] ___

[Betacluster-alerts] ** PROBLEM alert - deployment-kafka03/Free space - all mounts is CRITICAL **

2017-12-20 Thread shinken
Notification Type: PROBLEM Service: Free space - all mounts Host: deployment-kafka03 Address: 10.68.16.138 State: CRITICAL Date/Time: Wed 20 Dec 21:05:27 UTC 2017 Notes URLs: Additional Info: CRITICAL: deployment-prep.deployment-kafka03.diskspace.root.byte_percentfree (<44.44%)

[Betacluster-alerts] ** RECOVERY alert - Graphite Labs/Mediawiki Error Rate is OK **

2017-12-20 Thread shinken
Notification Type: RECOVERY Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: OK Date/Time: Wed 20 Dec 20:37:36 UTC 2017 Notes URLs: Additional Info: OK: Less than 1.00% above the threshold [1.0] ___

[Betacluster-alerts] ** PROBLEM alert - deployment-eventlogging04/Puppet errors is CRITICAL **

2017-12-20 Thread shinken
Notification Type: PROBLEM Service: Puppet errors Host: deployment-eventlogging04 Address: 10.68.23.204 State: CRITICAL Date/Time: Wed 20 Dec 20:34:28 UTC 2017 Notes URLs: Additional Info: CRITICAL: 100.00% of data above the critical threshold [0.0]

[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is CRITICAL **

2017-12-20 Thread shinken
Notification Type: PROBLEM Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: CRITICAL Date/Time: Wed 20 Dec 19:52:36 UTC 2017 Notes URLs: Additional Info: CRITICAL: 80.00% of data above the critical threshold [10.0]

[Betacluster-alerts] ** RECOVERY alert - Graphite Labs/Mediawiki Error Rate is OK **

2017-12-20 Thread shinken
Notification Type: RECOVERY Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: OK Date/Time: Wed 20 Dec 19:21:37 UTC 2017 Notes URLs: Additional Info: OK: Less than 1.00% above the threshold [1.0] ___

[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is WARNING **

2017-12-20 Thread shinken
Notification Type: PROBLEM Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: WARNING Date/Time: Wed 20 Dec 19:16:38 UTC 2017 Notes URLs: Additional Info: WARNING: 20.00% of data above the warning threshold [1.0]

[Betacluster-alerts] ** RECOVERY alert - Graphite Labs/Mediawiki Error Rate is OK **

2017-12-20 Thread shinken
Notification Type: RECOVERY Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: OK Date/Time: Wed 20 Dec 19:10:37 UTC 2017 Notes URLs: Additional Info: OK: Less than 1.00% above the threshold [1.0] ___

[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is WARNING **

2017-12-20 Thread shinken
Notification Type: PROBLEM Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: WARNING Date/Time: Wed 20 Dec 18:45:36 UTC 2017 Notes URLs: Additional Info: WARNING: 20.00% of data above the warning threshold [1.0]

[Betacluster-alerts] ** PROBLEM alert - deployment-mx/Puppet errors is CRITICAL **

2017-12-20 Thread shinken
Notification Type: PROBLEM Service: Puppet errors Host: deployment-mx Address: 10.68.17.78 State: CRITICAL Date/Time: Wed 20 Dec 18:39:21 UTC 2017 Notes URLs: Additional Info: CRITICAL: 100.00% of data above the critical threshold [0.0] ___

[Betacluster-alerts] ** RECOVERY alert - Graphite Labs/Mediawiki Error Rate is OK **

2017-12-20 Thread shinken
Notification Type: RECOVERY Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: OK Date/Time: Wed 20 Dec 15:59:36 UTC 2017 Notes URLs: Additional Info: OK: Less than 1.00% above the threshold [1.0] ___

[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is WARNING **

2017-12-20 Thread shinken
Notification Type: PROBLEM Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: WARNING Date/Time: Wed 20 Dec 15:34:37 UTC 2017 Notes URLs: Additional Info: WARNING: 40.00% of data above the warning threshold [1.0]

[Betacluster-alerts] ** PROBLEM alert - deployment-redis02/Puppet errors is CRITICAL **

2017-12-20 Thread shinken
Notification Type: PROBLEM Service: Puppet errors Host: deployment-redis02 Address: 10.68.16.231 State: CRITICAL Date/Time: Wed 20 Dec 15:33:41 UTC 2017 Notes URLs: Additional Info: CRITICAL: 100.00% of data above the critical threshold [0.0] ___

[Betacluster-alerts] ** RECOVERY alert - deployment-db03/Free space - all mounts is OK **

2017-12-20 Thread shinken
Notification Type: RECOVERY Service: Free space - all mounts Host: deployment-db03 Address: 10.68.23.30 State: OK Date/Time: Wed 20 Dec 15:28:35 UTC 2017 Notes URLs: Additional Info: OK: deployment-prep.deployment-db03.diskspace._mnt_sqldata.byte_percentfree (No valid datapoints found)

[Betacluster-alerts] ** PROBLEM alert - deployment-redis01/Puppet errors is CRITICAL **

2017-12-20 Thread shinken
Notification Type: PROBLEM Service: Puppet errors Host: deployment-redis01 Address: 10.68.16.177 State: CRITICAL Date/Time: Wed 20 Dec 15:27:43 UTC 2017 Notes URLs: Additional Info: CRITICAL: 100.00% of data above the critical threshold [0.0] ___

[Betacluster-alerts] ** RECOVERY alert - Graphite Labs/Mediawiki Error Rate is OK **

2017-12-20 Thread shinken
Notification Type: RECOVERY Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: OK Date/Time: Wed 20 Dec 15:23:37 UTC 2017 Notes URLs: Additional Info: OK: Less than 1.00% above the threshold [1.0] ___

[Betacluster-alerts] ** PROBLEM alert - deployment-redis06/Puppet errors is CRITICAL **

2017-12-20 Thread shinken
Notification Type: PROBLEM Service: Puppet errors Host: deployment-redis06 Address: 10.68.20.16 State: CRITICAL Date/Time: Wed 20 Dec 15:15:00 UTC 2017 Notes URLs: Additional Info: CRITICAL: 100.00% of data above the critical threshold [0.0] ___

[Betacluster-alerts] ** PROBLEM alert - deployment-db03/Free space - all mounts is CRITICAL **

2017-12-20 Thread shinken
Notification Type: PROBLEM Service: Free space - all mounts Host: deployment-db03 Address: 10.68.23.30 State: CRITICAL Date/Time: Wed 20 Dec 15:13:35 UTC 2017 Notes URLs: Additional Info: CRITICAL: deployment-prep.deployment-db03.diskspace._mnt_sqldata.byte_percentfree (No valid datapoints

[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is WARNING **

2017-12-20 Thread shinken
Notification Type: PROBLEM Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: WARNING Date/Time: Wed 20 Dec 15:13:39 UTC 2017 Notes URLs: Additional Info: WARNING: 20.00% of data above the warning threshold [1.0]

[Betacluster-alerts] ** RECOVERY alert - Graphite Labs/Mediawiki Error Rate is OK **

2017-12-20 Thread shinken
Notification Type: RECOVERY Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: OK Date/Time: Wed 20 Dec 12:52:37 UTC 2017 Notes URLs: Additional Info: OK: Less than 1.00% above the threshold [1.0] ___

[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is CRITICAL **

2017-12-20 Thread shinken
Notification Type: PROBLEM Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: CRITICAL Date/Time: Wed 20 Dec 12:47:36 UTC 2017 Notes URLs: Additional Info: CRITICAL: 20.00% of data above the critical threshold [10.0]

[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is WARNING **

2017-12-20 Thread shinken
Notification Type: PROBLEM Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: WARNING Date/Time: Wed 20 Dec 12:37:39 UTC 2017 Notes URLs: Additional Info: WARNING: 80.00% of data above the warning threshold [1.0]

[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is CRITICAL **

2017-12-20 Thread shinken
Notification Type: PROBLEM Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: CRITICAL Date/Time: Wed 20 Dec 12:02:37 UTC 2017 Notes URLs: Additional Info: CRITICAL: 60.00% of data above the critical threshold [10.0]

[Betacluster-alerts] ** PROBLEM alert - deployment-trending01/Puppet errors is CRITICAL **

2017-12-20 Thread shinken
Notification Type: PROBLEM Service: Puppet errors Host: deployment-trending01 Address: 10.68.18.186 State: CRITICAL Date/Time: Wed 20 Dec 11:27:33 UTC 2017 Notes URLs: Additional Info: CRITICAL: 100.00% of data above the critical threshold [0.0]

[Betacluster-alerts] ** PROBLEM alert - deployment-kafka03/Free space - all mounts is WARNING **

2017-12-20 Thread shinken
Notification Type: PROBLEM Service: Free space - all mounts Host: deployment-kafka03 Address: 10.68.16.138 State: WARNING Date/Time: Wed 20 Dec 11:00:27 UTC 2017 Notes URLs: Additional Info: WARNING: deployment-prep.deployment-kafka03.diskspace.root.byte_percentfree (<22.22%)

[Betacluster-alerts] ** PROBLEM alert - deployment-eventlog02/Free space - all mounts is WARNING **

2017-12-20 Thread shinken
Notification Type: PROBLEM Service: Free space - all mounts Host: deployment-eventlog02 Address: 10.68.18.138 State: WARNING Date/Time: Wed 20 Dec 09:42:11 UTC 2017 Notes URLs: Additional Info: WARNING: deployment-prep.deployment-eventlog02.diskspace.root.byte_percentfree (<66.67%)