[Betacluster-alerts] ** RECOVERY alert - deployment-kafka01/Free space - all mounts is OK **

2018-01-13 Thread shinken
Notification Type: RECOVERY

Service: Free space - all mounts
Host: deployment-kafka01
Address: 10.68.21.219
State: OK

Date/Time: Sun 14 Jan 07:08:29 UTC 2018

Notes URLs: 

Additional Info:

OK: All targets OK
___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts


[Betacluster-alerts] ** RECOVERY alert - deployment-fluorine02/Free space - all mounts is OK **

2018-01-13 Thread shinken
Notification Type: RECOVERY

Service: Free space - all mounts
Host: deployment-fluorine02
Address: 10.68.23.106
State: OK

Date/Time: Sun 14 Jan 06:56:05 UTC 2018

Notes URLs: 

Additional Info:

OK: All targets OK
___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts


[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is WARNING **

2018-01-13 Thread shinken
Notification Type: PROBLEM

Service: Mediawiki Error Rate
Host: Graphite Labs
Address: graphite-labs.wikimedia.org
State: WARNING

Date/Time: Sun 14 Jan 06:12:41 UTC 2018

Notes URLs: 

Additional Info:

WARNING: 20.00% of data above the warning threshold [1.0]
___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts


[Betacluster-alerts] ** RECOVERY alert - Graphite Labs/Mediawiki Error Rate is OK **

2018-01-13 Thread shinken
Notification Type: RECOVERY

Service: Mediawiki Error Rate
Host: Graphite Labs
Address: graphite-labs.wikimedia.org
State: OK

Date/Time: Sun 14 Jan 06:06:42 UTC 2018

Notes URLs: 

Additional Info:

OK: Less than 1.00% above the threshold [1.0]
___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts


[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is WARNING **

2018-01-13 Thread shinken
Notification Type: PROBLEM

Service: Mediawiki Error Rate
Host: Graphite Labs
Address: graphite-labs.wikimedia.org
State: WARNING

Date/Time: Sun 14 Jan 06:01:41 UTC 2018

Notes URLs: 

Additional Info:

WARNING: 20.00% of data above the warning threshold [1.0]
___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts


[Betacluster-alerts] ** PROBLEM alert - deployment-fluorine02/Free space - all mounts is WARNING **

2018-01-13 Thread shinken
Notification Type: PROBLEM

Service: Free space - all mounts
Host: deployment-fluorine02
Address: 10.68.23.106
State: WARNING

Date/Time: Sun 14 Jan 05:01:06 UTC 2018

Notes URLs: 

Additional Info:

WARNING: deployment-prep.deployment-fluorine02.diskspace._srv.byte_percentfree 
(<66.67%)
___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts


[Betacluster-alerts] ** RECOVERY alert - Graphite Labs/Mediawiki Error Rate is OK **

2018-01-13 Thread shinken
Notification Type: RECOVERY

Service: Mediawiki Error Rate
Host: Graphite Labs
Address: graphite-labs.wikimedia.org
State: OK

Date/Time: Sun 14 Jan 05:00:41 UTC 2018

Notes URLs: 

Additional Info:

OK: Less than 1.00% above the threshold [1.0]
___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts


[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is WARNING **

2018-01-13 Thread shinken
Notification Type: PROBLEM

Service: Mediawiki Error Rate
Host: Graphite Labs
Address: graphite-labs.wikimedia.org
State: WARNING

Date/Time: Sun 14 Jan 04:55:40 UTC 2018

Notes URLs: 

Additional Info:

WARNING: 20.00% of data above the warning threshold [1.0]
___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts


[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is WARNING **

2018-01-13 Thread shinken
Notification Type: PROBLEM

Service: Mediawiki Error Rate
Host: Graphite Labs
Address: graphite-labs.wikimedia.org
State: WARNING

Date/Time: Sun 14 Jan 02:38:42 UTC 2018

Notes URLs: 

Additional Info:

WARNING: 20.00% of data above the warning threshold [1.0]
___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts


[Betacluster-alerts] ** RECOVERY alert - Graphite Labs/Mediawiki Error Rate is OK **

2018-01-13 Thread shinken
Notification Type: RECOVERY

Service: Mediawiki Error Rate
Host: Graphite Labs
Address: graphite-labs.wikimedia.org
State: OK

Date/Time: Sun 14 Jan 02:22:41 UTC 2018

Notes URLs: 

Additional Info:

OK: Less than 1.00% above the threshold [1.0]
___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts


[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is WARNING **

2018-01-13 Thread shinken
Notification Type: PROBLEM

Service: Mediawiki Error Rate
Host: Graphite Labs
Address: graphite-labs.wikimedia.org
State: WARNING

Date/Time: Sun 14 Jan 02:12:40 UTC 2018

Notes URLs: 

Additional Info:

WARNING: 20.00% of data above the warning threshold [1.0]
___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts


[Betacluster-alerts] ** RECOVERY alert - Graphite Labs/Mediawiki Error Rate is OK **

2018-01-13 Thread shinken
Notification Type: RECOVERY

Service: Mediawiki Error Rate
Host: Graphite Labs
Address: graphite-labs.wikimedia.org
State: OK

Date/Time: Sun 14 Jan 01:36:40 UTC 2018

Notes URLs: 

Additional Info:

OK: Less than 1.00% above the threshold [1.0]
___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts


[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is WARNING **

2018-01-13 Thread shinken
Notification Type: PROBLEM

Service: Mediawiki Error Rate
Host: Graphite Labs
Address: graphite-labs.wikimedia.org
State: WARNING

Date/Time: Sun 14 Jan 01:31:42 UTC 2018

Notes URLs: 

Additional Info:

WARNING: 20.00% of data above the warning threshold [1.0]
___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts


[Betacluster-alerts] ** PROBLEM alert - deployment-puppetmaster02/Long lived cherry-picks on puppetmaster is CRITICAL **

2018-01-13 Thread shinken
Notification Type: PROBLEM

Service: Long lived cherry-picks on puppetmaster
Host: deployment-puppetmaster02
Address: 10.68.21.200
State: CRITICAL

Date/Time: Sun 14 Jan 00:31:15 UTC 2018

Notes URLs: 

Additional Info:

CRITICAL: 100.00% of data above the critical threshold [0.0]
___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts


[Betacluster-alerts] ** PROBLEM alert - deployment-netbox/Puppet errors is CRITICAL **

2018-01-13 Thread shinken
Notification Type: PROBLEM

Service: Puppet errors
Host: deployment-netbox
Address: 10.68.19.203
State: CRITICAL

Date/Time: Sat 13 Jan 23:36:08 UTC 2018

Notes URLs: 

Additional Info:

CRITICAL: 100.00% of data above the critical threshold [0.0]
___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts


[Betacluster-alerts] ** RECOVERY alert - Graphite Labs/Mediawiki Error Rate is OK **

2018-01-13 Thread shinken
Notification Type: RECOVERY

Service: Mediawiki Error Rate
Host: Graphite Labs
Address: graphite-labs.wikimedia.org
State: OK

Date/Time: Sat 13 Jan 21:38:42 UTC 2018

Notes URLs: 

Additional Info:

OK: Less than 1.00% above the threshold [1.0]
___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts


[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is WARNING **

2018-01-13 Thread shinken
Notification Type: PROBLEM

Service: Mediawiki Error Rate
Host: Graphite Labs
Address: graphite-labs.wikimedia.org
State: WARNING

Date/Time: Sat 13 Jan 21:33:41 UTC 2018

Notes URLs: 

Additional Info:

WARNING: 20.00% of data above the warning threshold [1.0]
___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts


[Betacluster-alerts] ** PROBLEM alert - deployment-mx/Free space - all mounts is CRITICAL **

2018-01-13 Thread shinken
Notification Type: PROBLEM

Service: Free space - all mounts
Host: deployment-mx
Address: 10.68.17.78
State: CRITICAL

Date/Time: Sat 13 Jan 21:06:14 UTC 2018

Notes URLs: 

Additional Info:

CRITICAL: deployment-prep.deployment-mx.diskspace._var_log.byte_percentfree 
(<100.00%)
___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts


[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is WARNING **

2018-01-13 Thread shinken
Notification Type: PROBLEM

Service: Mediawiki Error Rate
Host: Graphite Labs
Address: graphite-labs.wikimedia.org
State: WARNING

Date/Time: Sat 13 Jan 20:27:41 UTC 2018

Notes URLs: 

Additional Info:

WARNING: 80.00% of data above the warning threshold [1.0]
___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts


[Betacluster-alerts] ** RECOVERY alert - Graphite Labs/Mediawiki Error Rate is OK **

2018-01-13 Thread shinken
Notification Type: RECOVERY

Service: Mediawiki Error Rate
Host: Graphite Labs
Address: graphite-labs.wikimedia.org
State: OK

Date/Time: Sat 13 Jan 20:21:42 UTC 2018

Notes URLs: 

Additional Info:

OK: Less than 1.00% above the threshold [1.0]
___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts


[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is WARNING **

2018-01-13 Thread shinken
Notification Type: PROBLEM

Service: Mediawiki Error Rate
Host: Graphite Labs
Address: graphite-labs.wikimedia.org
State: WARNING

Date/Time: Sat 13 Jan 20:11:40 UTC 2018

Notes URLs: 

Additional Info:

WARNING: 20.00% of data above the warning threshold [1.0]
___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts


[Betacluster-alerts] ** PROBLEM alert - deployment-kafka03/Puppet staleness is CRITICAL **

2018-01-13 Thread shinken
Notification Type: PROBLEM

Service: Puppet staleness
Host: deployment-kafka03
Address: 10.68.16.138
State: CRITICAL

Date/Time: Sat 13 Jan 18:58:54 UTC 2018

Notes URLs: 

Additional Info:

CRITICAL: 100.00% of data above the critical threshold [43200.0]
___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts


[Betacluster-alerts] ** PROBLEM alert - deployment-kafka03/Free space - all mounts is CRITICAL **

2018-01-13 Thread shinken
Notification Type: PROBLEM

Service: Free space - all mounts
Host: deployment-kafka03
Address: 10.68.16.138
State: CRITICAL

Date/Time: Sat 13 Jan 18:54:29 UTC 2018

Notes URLs: 

Additional Info:

CRITICAL: deployment-prep.deployment-kafka03.diskspace.root.byte_percentfree 
(<100.00%)
___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts


[Betacluster-alerts] ** PROBLEM alert - deployment-mx/Puppet errors is CRITICAL **

2018-01-13 Thread shinken
Notification Type: PROBLEM

Service: Puppet errors
Host: deployment-mx
Address: 10.68.17.78
State: CRITICAL

Date/Time: Sat 13 Jan 18:39:21 UTC 2018

Notes URLs: 

Additional Info:

CRITICAL: 100.00% of data above the critical threshold [0.0]
___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts


[Betacluster-alerts] ** PROBLEM alert - deployment-kafka01/Free space - all mounts is CRITICAL **

2018-01-13 Thread shinken
Notification Type: PROBLEM

Service: Free space - all mounts
Host: deployment-kafka01
Address: 10.68.21.219
State: CRITICAL

Date/Time: Sat 13 Jan 16:18:30 UTC 2018

Notes URLs: 

Additional Info:

CRITICAL: deployment-prep.deployment-kafka01.diskspace.root.byte_percentfree 
(<100.00%)
___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts


[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is WARNING **

2018-01-13 Thread shinken
Notification Type: PROBLEM

Service: Mediawiki Error Rate
Host: Graphite Labs
Address: graphite-labs.wikimedia.org
State: WARNING

Date/Time: Sat 13 Jan 15:58:40 UTC 2018

Notes URLs: 

Additional Info:

WARNING: 20.00% of data above the warning threshold [1.0]
___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts


[Betacluster-alerts] ** RECOVERY alert - Graphite Labs/Mediawiki Error Rate is OK **

2018-01-13 Thread shinken
Notification Type: RECOVERY

Service: Mediawiki Error Rate
Host: Graphite Labs
Address: graphite-labs.wikimedia.org
State: OK

Date/Time: Sat 13 Jan 15:52:41 UTC 2018

Notes URLs: 

Additional Info:

OK: Less than 1.00% above the threshold [1.0]
___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts


[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is WARNING **

2018-01-13 Thread shinken
Notification Type: PROBLEM

Service: Mediawiki Error Rate
Host: Graphite Labs
Address: graphite-labs.wikimedia.org
State: WARNING

Date/Time: Sat 13 Jan 15:47:42 UTC 2018

Notes URLs: 

Additional Info:

WARNING: 20.00% of data above the warning threshold [1.0]
___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts


[Betacluster-alerts] ** PROBLEM alert - deployment-redis02/Puppet errors is CRITICAL **

2018-01-13 Thread shinken
Notification Type: PROBLEM

Service: Puppet errors
Host: deployment-redis02
Address: 10.68.16.231
State: CRITICAL

Date/Time: Sat 13 Jan 15:33:41 UTC 2018

Notes URLs: 

Additional Info:

CRITICAL: 100.00% of data above the critical threshold [0.0]
___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts


[Betacluster-alerts] ** RECOVERY alert - Graphite Labs/Mediawiki Error Rate is OK **

2018-01-13 Thread shinken
Notification Type: RECOVERY

Service: Mediawiki Error Rate
Host: Graphite Labs
Address: graphite-labs.wikimedia.org
State: OK

Date/Time: Sat 13 Jan 15:31:40 UTC 2018

Notes URLs: 

Additional Info:

OK: Less than 1.00% above the threshold [1.0]
___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts


[Betacluster-alerts] ** PROBLEM alert - deployment-redis01/Puppet errors is CRITICAL **

2018-01-13 Thread shinken
Notification Type: PROBLEM

Service: Puppet errors
Host: deployment-redis01
Address: 10.68.16.177
State: CRITICAL

Date/Time: Sat 13 Jan 15:27:43 UTC 2018

Notes URLs: 

Additional Info:

CRITICAL: 100.00% of data above the critical threshold [0.0]
___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts


[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is WARNING **

2018-01-13 Thread shinken
Notification Type: PROBLEM

Service: Mediawiki Error Rate
Host: Graphite Labs
Address: graphite-labs.wikimedia.org
State: WARNING

Date/Time: Sat 13 Jan 15:26:40 UTC 2018

Notes URLs: 

Additional Info:

WARNING: 20.00% of data above the warning threshold [1.0]
___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts


[Betacluster-alerts] ** RECOVERY alert - Graphite Labs/Mediawiki Error Rate is OK **

2018-01-13 Thread shinken
Notification Type: RECOVERY

Service: Mediawiki Error Rate
Host: Graphite Labs
Address: graphite-labs.wikimedia.org
State: OK

Date/Time: Sat 13 Jan 12:30:40 UTC 2018

Notes URLs: 

Additional Info:

OK: Less than 1.00% above the threshold [1.0]
___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts


[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is WARNING **

2018-01-13 Thread shinken
Notification Type: PROBLEM

Service: Mediawiki Error Rate
Host: Graphite Labs
Address: graphite-labs.wikimedia.org
State: WARNING

Date/Time: Sat 13 Jan 12:25:40 UTC 2018

Notes URLs: 

Additional Info:

WARNING: 20.00% of data above the warning threshold [1.0]
___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts


[Betacluster-alerts] ** RECOVERY alert - Graphite Labs/Mediawiki Error Rate is OK **

2018-01-13 Thread shinken
Notification Type: RECOVERY

Service: Mediawiki Error Rate
Host: Graphite Labs
Address: graphite-labs.wikimedia.org
State: OK

Date/Time: Sat 13 Jan 10:18:42 UTC 2018

Notes URLs: 

Additional Info:

OK: Less than 1.00% above the threshold [1.0]
___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts


[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is WARNING **

2018-01-13 Thread shinken
Notification Type: PROBLEM

Service: Mediawiki Error Rate
Host: Graphite Labs
Address: graphite-labs.wikimedia.org
State: WARNING

Date/Time: Sat 13 Jan 09:17:41 UTC 2018

Notes URLs: 

Additional Info:

WARNING: 20.00% of data above the warning threshold [1.0]
___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts


[Betacluster-alerts] ** RECOVERY alert - Graphite Labs/Mediawiki Error Rate is OK **

2018-01-13 Thread shinken
Notification Type: RECOVERY

Service: Mediawiki Error Rate
Host: Graphite Labs
Address: graphite-labs.wikimedia.org
State: OK

Date/Time: Sat 13 Jan 09:01:40 UTC 2018

Notes URLs: 

Additional Info:

OK: Less than 1.00% above the threshold [1.0]
___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts


[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is WARNING **

2018-01-13 Thread shinken
Notification Type: PROBLEM

Service: Mediawiki Error Rate
Host: Graphite Labs
Address: graphite-labs.wikimedia.org
State: WARNING

Date/Time: Sat 13 Jan 08:56:43 UTC 2018

Notes URLs: 

Additional Info:

WARNING: 20.00% of data above the warning threshold [1.0]
___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts