[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is WARNING **

2017-10-15 Thread shinken
Notification Type: PROBLEM

Service: Mediawiki Error Rate
Host: Graphite Labs
Address: graphite-labs.wikimedia.org
State: WARNING

Date/Time: Mon 16 Oct 05:22:48 UTC 2017

Additional Info:

WARNING: 80.00% of data above the warning threshold [1.0]
___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts


[Betacluster-alerts] ** PROBLEM alert - deployment-fluorine02/Free space - all mounts is WARNING **

2017-10-15 Thread shinken
Notification Type: PROBLEM

Service: Free space - all mounts
Host: deployment-fluorine02
Address: 10.68.23.106
State: WARNING

Date/Time: Mon 16 Oct 05:18:01 UTC 2017

Additional Info:

WARNING: deployment-prep.deployment-fluorine02.diskspace._srv.byte_percentfree 
(<30.00%)
___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts


[Betacluster-alerts] ** RECOVERY alert - Graphite Labs/Mediawiki Error Rate is OK **

2017-10-15 Thread shinken
Notification Type: RECOVERY

Service: Mediawiki Error Rate
Host: Graphite Labs
Address: graphite-labs.wikimedia.org
State: OK

Date/Time: Mon 16 Oct 05:16:49 UTC 2017

Additional Info:

OK: Less than 1.00% above the threshold [1.0]
___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts


[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is WARNING **

2017-10-15 Thread shinken
Notification Type: PROBLEM

Service: Mediawiki Error Rate
Host: Graphite Labs
Address: graphite-labs.wikimedia.org
State: WARNING

Date/Time: Mon 16 Oct 04:46:47 UTC 2017

Additional Info:

WARNING: 80.00% of data above the warning threshold [1.0]
___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts


[Betacluster-alerts] ** RECOVERY alert - Graphite Labs/Mediawiki Error Rate is OK **

2017-10-15 Thread shinken
Notification Type: RECOVERY

Service: Mediawiki Error Rate
Host: Graphite Labs
Address: graphite-labs.wikimedia.org
State: OK

Date/Time: Mon 16 Oct 04:10:48 UTC 2017

Additional Info:

OK: Less than 1.00% above the threshold [1.0]
___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts


[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is WARNING **

2017-10-15 Thread shinken
Notification Type: PROBLEM

Service: Mediawiki Error Rate
Host: Graphite Labs
Address: graphite-labs.wikimedia.org
State: WARNING

Date/Time: Mon 16 Oct 04:05:47 UTC 2017

Additional Info:

WARNING: 20.00% of data above the warning threshold [1.0]
___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts


[Betacluster-alerts] ** PROBLEM alert - deployment-restbase02/Puppet staleness is CRITICAL **

2017-10-15 Thread shinken
Notification Type: PROBLEM

Service: Puppet staleness
Host: deployment-restbase02
Address: 10.68.17.189
State: CRITICAL

Date/Time: Mon 16 Oct 01:02:15 UTC 2017

Additional Info:

CRITICAL: 100.00% of data above the critical threshold [43200.0]
___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts


[Betacluster-alerts] ** RECOVERY alert - deployment-mediawiki05/Free space - all mounts is OK **

2017-10-15 Thread shinken
Notification Type: RECOVERY

Service: Free space - all mounts
Host: deployment-mediawiki05
Address: 10.68.22.21
State: OK

Date/Time: Sun 15 Oct 19:49:11 UTC 2017

Additional Info:

OK: All targets OK
___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts


[Betacluster-alerts] ** PROBLEM alert - deployment-mediawiki05/Free space - all mounts is WARNING **

2017-10-15 Thread shinken
Notification Type: PROBLEM

Service: Free space - all mounts
Host: deployment-mediawiki05
Address: 10.68.22.21
State: WARNING

Date/Time: Sun 15 Oct 19:39:10 UTC 2017

Additional Info:

WARNING: deployment-prep.deployment-mediawiki05.diskspace.root.byte_percentfree 
(<11.11%)
___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts


[Betacluster-alerts] ** RECOVERY alert - Graphite Labs/Mediawiki Error Rate is OK **

2017-10-15 Thread shinken
Notification Type: RECOVERY

Service: Mediawiki Error Rate
Host: Graphite Labs
Address: graphite-labs.wikimedia.org
State: OK

Date/Time: Sun 15 Oct 18:59:47 UTC 2017

Additional Info:

OK: Less than 1.00% above the threshold [1.0]
___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts


[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is WARNING **

2017-10-15 Thread shinken
Notification Type: PROBLEM

Service: Mediawiki Error Rate
Host: Graphite Labs
Address: graphite-labs.wikimedia.org
State: WARNING

Date/Time: Sun 15 Oct 18:54:49 UTC 2017

Additional Info:

WARNING: 20.00% of data above the warning threshold [1.0]
___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts


[Betacluster-alerts] ** PROBLEM alert - deployment-mx/Puppet errors is CRITICAL **

2017-10-15 Thread shinken
Notification Type: PROBLEM

Service: Puppet errors
Host: deployment-mx
Address: 10.68.17.78
State: CRITICAL

Date/Time: Sun 15 Oct 18:39:21 UTC 2017

Additional Info:

CRITICAL: 100.00% of data above the critical threshold [0.0]
___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts


[Betacluster-alerts] ** PROBLEM alert - deployment-aqs01/Puppet errors is CRITICAL **

2017-10-15 Thread shinken
Notification Type: PROBLEM

Service: Puppet errors
Host: deployment-aqs01
Address: 10.68.18.237
State: CRITICAL

Date/Time: Sun 15 Oct 15:34:00 UTC 2017

Additional Info:

CRITICAL: 100.00% of data above the critical threshold [0.0]
___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts


[Betacluster-alerts] ** PROBLEM alert - deployment-kafka01/Free space - all mounts is CRITICAL **

2017-10-15 Thread shinken
Notification Type: PROBLEM

Service: Free space - all mounts
Host: deployment-kafka01
Address: 10.68.21.219
State: CRITICAL

Date/Time: Sun 15 Oct 15:34:03 UTC 2017

Additional Info:

CRITICAL: deployment-prep.deployment-kafka01.diskspace.root.byte_percentfree 
(<100.00%)
___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts


[Betacluster-alerts] ** RECOVERY alert - deployment-zotero01/Puppet errors is OK **

2017-10-15 Thread shinken
Notification Type: RECOVERY

Service: Puppet errors
Host: deployment-zotero01
Address: 10.68.17.102
State: OK

Date/Time: Sun 15 Oct 15:24:40 UTC 2017

Additional Info:

OK: Less than 1.00% above the threshold [0.0]
___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts


[Betacluster-alerts] ** PROBLEM alert - deployment-cache-text04/Puppet errors is CRITICAL **

2017-10-15 Thread shinken
Notification Type: PROBLEM

Service: Puppet errors
Host: deployment-cache-text04
Address: 10.68.18.103
State: CRITICAL

Date/Time: Sun 15 Oct 15:21:50 UTC 2017

Additional Info:

CRITICAL: 100.00% of data above the critical threshold [0.0]
___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts


[Betacluster-alerts] ** PROBLEM alert - deployment-aqs03/Puppet errors is CRITICAL **

2017-10-15 Thread shinken
Notification Type: PROBLEM

Service: Puppet errors
Host: deployment-aqs03
Address: 10.68.17.125
State: CRITICAL

Date/Time: Sun 15 Oct 15:13:49 UTC 2017

Additional Info:

CRITICAL: 100.00% of data above the critical threshold [0.0]
___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts


[Betacluster-alerts] ** PROBLEM alert - deployment-cache-upload04/Puppet errors is CRITICAL **

2017-10-15 Thread shinken
Notification Type: PROBLEM

Service: Puppet errors
Host: deployment-cache-upload04
Address: 10.68.18.109
State: CRITICAL

Date/Time: Sun 15 Oct 15:10:09 UTC 2017

Additional Info:

CRITICAL: 100.00% of data above the critical threshold [0.0]
___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts


[Betacluster-alerts] ** PROBLEM alert - deployment-aqs02/Puppet errors is CRITICAL **

2017-10-15 Thread shinken
Notification Type: PROBLEM

Service: Puppet errors
Host: deployment-aqs02
Address: 10.68.17.90
State: CRITICAL

Date/Time: Sun 15 Oct 15:08:03 UTC 2017

Additional Info:

CRITICAL: 100.00% of data above the critical threshold [0.0]
___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts


[Betacluster-alerts] ** PROBLEM alert - deployment-zotero01/Puppet errors is CRITICAL **

2017-10-15 Thread shinken
Notification Type: PROBLEM

Service: Puppet errors
Host: deployment-zotero01
Address: 10.68.17.102
State: CRITICAL

Date/Time: Sun 15 Oct 14:44:41 UTC 2017

Additional Info:

CRITICAL: 30.00% of data above the critical threshold [0.0]
___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts


[Betacluster-alerts] ** PROBLEM alert - deployment-mediawiki07/App Server Main HTTP Response is CRITICAL **

2017-10-15 Thread shinken
Notification Type: PROBLEM

Service: App Server Main HTTP Response
Host: deployment-mediawiki07
Address: 10.68.17.40
State: CRITICAL

Date/Time: Sun 15 Oct 11:37:57 UTC 2017

Additional Info:

HTTP CRITICAL: HTTP/1.1 404 Not Found - string 'Wikipedia' not found on 
'http://en.wikipedia.beta.wmflabs.org:80/wiki/Main_Page?debug=true' - 392 bytes 
in 0.002 second response time
___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts


[Betacluster-alerts] ** PROBLEM alert - deployment-trending01/Puppet errors is CRITICAL **

2017-10-15 Thread shinken
Notification Type: PROBLEM

Service: Puppet errors
Host: deployment-trending01
Address: 10.68.18.186
State: CRITICAL

Date/Time: Sun 15 Oct 09:02:01 UTC 2017

Additional Info:

CRITICAL: 100.00% of data above the critical threshold [0.0]
___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts


[Betacluster-alerts] ** RECOVERY alert - Graphite Labs/Mediawiki Error Rate is OK **

2017-10-15 Thread shinken
Notification Type: RECOVERY

Service: Mediawiki Error Rate
Host: Graphite Labs
Address: graphite-labs.wikimedia.org
State: OK

Date/Time: Sun 15 Oct 08:48:48 UTC 2017

Additional Info:

OK: Less than 1.00% above the threshold [1.0]
___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts


[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is WARNING **

2017-10-15 Thread shinken
Notification Type: PROBLEM

Service: Mediawiki Error Rate
Host: Graphite Labs
Address: graphite-labs.wikimedia.org
State: WARNING

Date/Time: Sun 15 Oct 07:43:48 UTC 2017

Additional Info:

WARNING: 80.00% of data above the warning threshold [1.0]
___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts


[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is CRITICAL **

2017-10-15 Thread shinken
Notification Type: PROBLEM

Service: Mediawiki Error Rate
Host: Graphite Labs
Address: graphite-labs.wikimedia.org
State: CRITICAL

Date/Time: Sun 15 Oct 07:38:48 UTC 2017

Additional Info:

CRITICAL: 20.00% of data above the critical threshold [10.0]
___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts


[Betacluster-alerts] ** RECOVERY alert - deployment-fluorine02/Free space - all mounts is OK **

2017-10-15 Thread shinken
Notification Type: RECOVERY

Service: Free space - all mounts
Host: deployment-fluorine02
Address: 10.68.23.106
State: OK

Date/Time: Sun 15 Oct 07:07:01 UTC 2017

Additional Info:

OK: All targets OK
___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts