[Betacluster-alerts] beta-scap-eqiad - Build # 179074 - Fixed!

beta-scap-eqiad - Build # 179074 - Fixed: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/179074/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] beta-scap-eqiad - Build # 179073 - Still Failing!

beta-scap-eqiad - Build # 179073 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/179073/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is WARNING **

Notification Type: PROBLEM Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: WARNING Date/Time: Wed 25 Oct 04:46:48 UTC 2017 Additional Info: WARNING: 80.00% of data above the warning threshold [1.0] ___

[Betacluster-alerts] beta-scap-eqiad - Build # 179072 - Still Failing!

beta-scap-eqiad - Build # 179072 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/179072/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] beta-scap-eqiad - Build # 179071 - Still Failing!

beta-scap-eqiad - Build # 179071 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/179071/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] beta-scap-eqiad - Build # 179070 - Still Failing!

beta-scap-eqiad - Build # 179070 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/179070/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] beta-scap-eqiad - Build # 179069 - Still Failing!

beta-scap-eqiad - Build # 179069 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/179069/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] beta-scap-eqiad - Build # 179068 - Still Failing!

beta-scap-eqiad - Build # 179068 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/179068/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] beta-scap-eqiad - Build # 179067 - Still Failing!

beta-scap-eqiad - Build # 179067 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/179067/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] beta-scap-eqiad - Build # 179064 - Still Failing!

beta-scap-eqiad - Build # 179064 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/179064/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] beta-scap-eqiad - Build # 179063 - Still Failing!

beta-scap-eqiad - Build # 179063 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/179063/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] beta-scap-eqiad - Build # 179062 - Still Failing!

beta-scap-eqiad - Build # 179062 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/179062/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] beta-scap-eqiad - Build # 179061 - Still Failing!

beta-scap-eqiad - Build # 179061 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/179061/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] beta-scap-eqiad - Build # 179060 - Still Failing!

beta-scap-eqiad - Build # 179060 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/179060/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] beta-scap-eqiad - Build # 179059 - Still Failing!

beta-scap-eqiad - Build # 179059 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/179059/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] beta-scap-eqiad - Build # 179058 - Still Failing!

beta-scap-eqiad - Build # 179058 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/179058/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] beta-scap-eqiad - Build # 179057 - Still Failing!

beta-scap-eqiad - Build # 179057 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/179057/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] beta-scap-eqiad - Build # 179056 - Still Failing!

beta-scap-eqiad - Build # 179056 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/179056/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] beta-scap-eqiad - Build # 179055 - Still Failing!

beta-scap-eqiad - Build # 179055 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/179055/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] beta-scap-eqiad - Build # 179054 - Still Failing!

beta-scap-eqiad - Build # 179054 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/179054/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] ** RECOVERY alert - deployment-aqs01/Puppet errors is OK **

Notification Type: RECOVERY Service: Puppet errors Host: deployment-aqs01 Address: 10.68.18.237 State: OK Date/Time: Wed 25 Oct 01:41:59 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list

[Betacluster-alerts] beta-scap-eqiad - Build # 179053 - Still Failing!

beta-scap-eqiad - Build # 179053 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/179053/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] beta-scap-eqiad - Build # 179051 - Still Failing!

beta-scap-eqiad - Build # 179051 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/179051/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] ** PROBLEM alert - deployment-aqs01/Puppet errors is CRITICAL **

Notification Type: PROBLEM Service: Puppet errors Host: deployment-aqs01 Address: 10.68.18.237 State: CRITICAL Date/Time: Wed 25 Oct 01:01:59 UTC 2017 Additional Info: CRITICAL: 20.00% of data above the critical threshold [0.0] ___ Betacluster-alerts

[Betacluster-alerts] beta-scap-eqiad - Build # 179049 - Still Failing!

beta-scap-eqiad - Build # 179049 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/179049/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] beta-scap-eqiad - Build # 179048 - Still Failing!

beta-scap-eqiad - Build # 179048 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/179048/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] beta-scap-eqiad - Build # 179047 - Still Failing!

beta-scap-eqiad - Build # 179047 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/179047/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] beta-scap-eqiad - Build # 179046 - Still Failing!

beta-scap-eqiad - Build # 179046 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/179046/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] beta-scap-eqiad - Build # 179044 - Still Failing!

beta-scap-eqiad - Build # 179044 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/179044/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] beta-scap-eqiad - Build # 179043 - Still Failing!

beta-scap-eqiad - Build # 179043 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/179043/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] beta-scap-eqiad - Build # 179042 - Still Failing!

beta-scap-eqiad - Build # 179042 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/179042/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] beta-scap-eqiad - Build # 179041 - Still Failing!

beta-scap-eqiad - Build # 179041 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/179041/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] beta-scap-eqiad - Build # 179040 - Still Failing!

beta-scap-eqiad - Build # 179040 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/179040/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] beta-scap-eqiad - Build # 179039 - Still Failing!

beta-scap-eqiad - Build # 179039 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/179039/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] beta-scap-eqiad - Build # 179038 - Still Failing!

beta-scap-eqiad - Build # 179038 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/179038/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] beta-scap-eqiad - Build # 179037 - Still Failing!

beta-scap-eqiad - Build # 179037 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/179037/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] beta-scap-eqiad - Build # 179035 - Still Failing!

beta-scap-eqiad - Build # 179035 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/179035/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] ** RECOVERY alert - deployment-cpjobqueue/Puppet errors is OK **

Notification Type: RECOVERY Service: Puppet errors Host: deployment-cpjobqueue Address: 10.68.22.161 State: OK Date/Time: Tue 24 Oct 22:29:27 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list

[Betacluster-alerts] beta-scap-eqiad - Build # 179034 - Still Failing!

beta-scap-eqiad - Build # 179034 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/179034/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] beta-scap-eqiad - Build # 179033 - Still Failing!

beta-scap-eqiad - Build # 179033 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/179033/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] beta-scap-eqiad - Build # 179032 - Still Failing!

beta-scap-eqiad - Build # 179032 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/179032/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] beta-scap-eqiad - Build # 179031 - Still Failing!

beta-scap-eqiad - Build # 179031 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/179031/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] beta-scap-eqiad - Build # 179030 - Still Failing!

beta-scap-eqiad - Build # 179030 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/179030/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] beta-scap-eqiad - Build # 179029 - Still Failing!

beta-scap-eqiad - Build # 179029 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/179029/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] beta-scap-eqiad - Build # 179028 - Still Failing!

beta-scap-eqiad - Build # 179028 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/179028/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] beta-scap-eqiad - Build # 179027 - Still Failing!

beta-scap-eqiad - Build # 179027 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/179027/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] beta-scap-eqiad - Build # 179026 - Still Failing!

beta-scap-eqiad - Build # 179026 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/179026/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] beta-scap-eqiad - Build # 179025 - Still Failing!

beta-scap-eqiad - Build # 179025 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/179025/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] beta-scap-eqiad - Build # 179024 - Still Failing!

beta-scap-eqiad - Build # 179024 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/179024/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] beta-scap-eqiad - Build # 179023 - Still Failing!

beta-scap-eqiad - Build # 179023 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/179023/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] beta-scap-eqiad - Build # 179022 - Still Failing!

beta-scap-eqiad - Build # 179022 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/179022/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] beta-scap-eqiad - Build # 179021 - Still Failing!

beta-scap-eqiad - Build # 179021 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/179021/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] beta-scap-eqiad - Build # 179020 - Still Failing!

beta-scap-eqiad - Build # 179020 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/179020/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] beta-scap-eqiad - Build # 179019 - Still Failing!

beta-scap-eqiad - Build # 179019 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/179019/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] beta-scap-eqiad - Build # 179018 - Still Failing!

beta-scap-eqiad - Build # 179018 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/179018/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] beta-scap-eqiad - Build # 179017 - Still Failing!

beta-scap-eqiad - Build # 179017 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/179017/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] beta-scap-eqiad - Build # 179016 - Still Failing!

beta-scap-eqiad - Build # 179016 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/179016/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] beta-scap-eqiad - Build # 179015 - Still Failing!

beta-scap-eqiad - Build # 179015 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/179015/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] beta-scap-eqiad - Build # 179014 - Still Failing!

beta-scap-eqiad - Build # 179014 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/179014/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] ** PROBLEM alert - deployment-eventlog02/Free space - all mounts is WARNING **

Notification Type: PROBLEM Service: Free space - all mounts Host: deployment-eventlog02 Address: 10.68.18.138 State: WARNING Date/Time: Tue 24 Oct 19:06:44 UTC 2017 Additional Info: WARNING: deployment-prep.deployment-eventlog02.diskspace.root.byte_percentfree (<30.00%)

[Betacluster-alerts] beta-scap-eqiad - Build # 179013 - Still Failing!

beta-scap-eqiad - Build # 179013 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/179013/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] beta-scap-eqiad - Build # 179012 - Still Failing!

beta-scap-eqiad - Build # 179012 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/179012/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] beta-scap-eqiad - Build # 179011 - Still Failing!

beta-scap-eqiad - Build # 179011 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/179011/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] beta-scap-eqiad - Build # 179010 - Still Failing!

beta-scap-eqiad - Build # 179010 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/179010/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] beta-scap-eqiad - Build # 179009 - Still Failing!

beta-scap-eqiad - Build # 179009 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/179009/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] beta-scap-eqiad - Build # 179008 - Still Failing!

beta-scap-eqiad - Build # 179008 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/179008/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] ** RECOVERY alert - deployment-sca02/Puppet errors is OK **

Notification Type: RECOVERY Service: Puppet errors Host: deployment-sca02 Address: 10.68.20.153 State: OK Date/Time: Tue 24 Oct 18:13:26 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list

[Betacluster-alerts] ** RECOVERY alert - deployment-aqs01/Puppet errors is OK **

Notification Type: RECOVERY Service: Puppet errors Host: deployment-aqs01 Address: 10.68.18.237 State: OK Date/Time: Tue 24 Oct 18:10:58 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list

[Betacluster-alerts] beta-scap-eqiad - Build # 179007 - Still Failing!

beta-scap-eqiad - Build # 179007 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/179007/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] beta-scap-eqiad - Build # 179006 - Failure!

beta-scap-eqiad - Build # 179006 - Failure: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/179006/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] ** PROBLEM alert - deployment-sca02/Puppet errors is CRITICAL **

Notification Type: PROBLEM Service: Puppet errors Host: deployment-sca02 Address: 10.68.20.153 State: CRITICAL Date/Time: Tue 24 Oct 17:53:25 UTC 2017 Additional Info: CRITICAL: 40.00% of data above the critical threshold [0.0] ___ Betacluster-alerts

[Betacluster-alerts] ** PROBLEM alert - deployment-aqs03/Puppet errors is CRITICAL **

Notification Type: PROBLEM Service: Puppet errors Host: deployment-aqs03 Address: 10.68.17.125 State: CRITICAL Date/Time: Tue 24 Oct 17:40:49 UTC 2017 Additional Info: CRITICAL: 20.00% of data above the critical threshold [0.0] ___ Betacluster-alerts

[Betacluster-alerts] ** PROBLEM alert - deployment-aqs01/Puppet errors is CRITICAL **

Notification Type: PROBLEM Service: Puppet errors Host: deployment-aqs01 Address: 10.68.18.237 State: CRITICAL Date/Time: Tue 24 Oct 17:35:59 UTC 2017 Additional Info: CRITICAL: 60.00% of data above the critical threshold [0.0] ___ Betacluster-alerts

[Betacluster-alerts] ** RECOVERY alert - deployment-redis02/Puppet errors is OK **

Notification Type: RECOVERY Service: Puppet errors Host: deployment-redis02 Address: 10.68.16.231 State: OK Date/Time: Tue 24 Oct 17:09:43 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list

[Betacluster-alerts] ** PROBLEM alert - deployment-redis02/Puppet errors is CRITICAL **

Notification Type: PROBLEM Service: Puppet errors Host: deployment-redis02 Address: 10.68.16.231 State: CRITICAL Date/Time: Tue 24 Oct 16:29:41 UTC 2017 Additional Info: CRITICAL: 20.00% of data above the critical threshold [0.0] ___

[Betacluster-alerts] ** RECOVERY alert - deployment-redis02/Puppet errors is OK **

Notification Type: RECOVERY Service: Puppet errors Host: deployment-redis02 Address: 10.68.16.231 State: OK Date/Time: Tue 24 Oct 14:08:41 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list

[Betacluster-alerts] ** PROBLEM alert - deployment-redis02/Puppet errors is CRITICAL **

Notification Type: PROBLEM Service: Puppet errors Host: deployment-redis02 Address: 10.68.16.231 State: CRITICAL Date/Time: Tue 24 Oct 13:33:41 UTC 2017 Additional Info: CRITICAL: 60.00% of data above the critical threshold [0.0] ___

[Betacluster-alerts] ** PROBLEM alert - deployment-puppetmaster02/Long lived cherry-picks on puppetmaster is CRITICAL **

Notification Type: PROBLEM Service: Long lived cherry-picks on puppetmaster Host: deployment-puppetmaster02 Address: 10.68.21.200 State: CRITICAL Date/Time: Tue 24 Oct 12:23:07 UTC 2017 Additional Info: CRITICAL: 100.00% of data above the critical threshold [0.0]

[Betacluster-alerts] ** RECOVERY alert - deployment-aqs03/Puppet errors is OK **

Notification Type: RECOVERY Service: Puppet errors Host: deployment-aqs03 Address: 10.68.17.125 State: OK Date/Time: Tue 24 Oct 11:49:49 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list

[Betacluster-alerts] ** RECOVERY alert - deployment-aqs02/Puppet errors is OK **

Notification Type: RECOVERY Service: Puppet errors Host: deployment-aqs02 Address: 10.68.17.90 State: OK Date/Time: Tue 24 Oct 11:44:04 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list

[Betacluster-alerts] ** RECOVERY alert - deployment-mira/Puppet errors is OK **

Notification Type: RECOVERY Service: Puppet errors Host: deployment-mira Address: 10.68.20.135 State: OK Date/Time: Tue 24 Oct 11:33:52 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list

[Betacluster-alerts] ** RECOVERY alert - deployment-aqs01/Puppet errors is OK **

Notification Type: RECOVERY Service: Puppet errors Host: deployment-aqs01 Address: 10.68.18.237 State: OK Date/Time: Tue 24 Oct 11:29:59 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list

[Betacluster-alerts] ** RECOVERY alert - deployment-tin/Puppet errors is OK **

Notification Type: RECOVERY Service: Puppet errors Host: deployment-tin Address: 10.68.21.205 State: OK Date/Time: Tue 24 Oct 11:08:25 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list

[Betacluster-alerts] ** PROBLEM alert - deployment-cpjobqueue/Puppet errors is CRITICAL **

Notification Type: PROBLEM Service: Puppet errors Host: deployment-cpjobqueue Address: 10.68.22.161 State: CRITICAL Date/Time: Tue 24 Oct 10:34:27 UTC 2017 Additional Info: CRITICAL: 100.00% of data above the critical threshold [0.0] ___

[Betacluster-alerts] ** PROBLEM alert - deployment-tin/Puppet errors is CRITICAL **

Notification Type: PROBLEM Service: Puppet errors Host: deployment-tin Address: 10.68.21.205 State: CRITICAL Date/Time: Tue 24 Oct 10:33:24 UTC 2017 Additional Info: CRITICAL: 30.00% of data above the critical threshold [0.0] ___ Betacluster-alerts

[Betacluster-alerts] ** RECOVERY alert - Graphite Labs/Mediawiki Error Rate is OK **

Notification Type: RECOVERY Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: OK Date/Time: Tue 24 Oct 09:15:49 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [1.0] ___ Betacluster-alerts

[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is WARNING **

Notification Type: PROBLEM Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: WARNING Date/Time: Tue 24 Oct 09:10:48 UTC 2017 Additional Info: WARNING: 20.00% of data above the warning threshold [1.0] ___

[Betacluster-alerts] ** RECOVERY alert - deployment-mediawiki04/Free space - all mounts is OK **

Notification Type: RECOVERY Service: Free space - all mounts Host: deployment-mediawiki04 Address: 10.68.19.128 State: OK Date/Time: Tue 24 Oct 09:08:54 UTC 2017 Additional Info: OK: All targets OK ___ Betacluster-alerts mailing list

[Betacluster-alerts] ** PROBLEM alert - deployment-mediawiki04/Free space - all mounts is WARNING **

Notification Type: PROBLEM Service: Free space - all mounts Host: deployment-mediawiki04 Address: 10.68.19.128 State: WARNING Date/Time: Tue 24 Oct 08:58:53 UTC 2017 Additional Info: WARNING: deployment-prep.deployment-mediawiki04.diskspace.root.byte_percentfree (<10.00%)

[Betacluster-alerts] ** RECOVERY alert - Graphite Labs/Mediawiki Error Rate is OK **

Notification Type: RECOVERY Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: OK Date/Time: Tue 24 Oct 08:49:48 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [1.0] ___ Betacluster-alerts

[Betacluster-alerts] ** RECOVERY alert - deployment-cache-upload04/Puppet errors is OK **

Notification Type: RECOVERY Service: Puppet errors Host: deployment-cache-upload04 Address: 10.68.18.109 State: OK Date/Time: Tue 24 Oct 08:40:06 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing

[Betacluster-alerts] ** RECOVERY alert - deployment-fluorine02/Free space - all mounts is OK **

Notification Type: RECOVERY Service: Free space - all mounts Host: deployment-fluorine02 Address: 10.68.23.106 State: OK Date/Time: Tue 24 Oct 07:09:00 UTC 2017 Additional Info: OK: All targets OK ___ Betacluster-alerts mailing list

[Betacluster-alerts] ** RECOVERY alert - deployment-eventlog02/Free space - all mounts is OK **

Notification Type: RECOVERY Service: Free space - all mounts Host: deployment-eventlog02 Address: 10.68.18.138 State: OK Date/Time: Tue 24 Oct 07:05:47 UTC 2017 Additional Info: OK: All targets OK ___ Betacluster-alerts mailing list