[Betacluster-alerts] selenium-daily-beta-MediaWiki - Build # 77 - Still Failing!

FAILURE: selenium-daily-beta-MediaWiki Build #77 (Fri, 09 Nov 2018 07:40:00 +) ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts

[Betacluster-alerts] ** RECOVERY alert - deployment-deploy01/Free space - all mounts is OK **

Notification Type: RECOVERY Service: Free space - all mounts Host: deployment-deploy01 Address: 10.68.23.38 State: OK Date/Time: Fri 09 Nov 07:30:57 UTC 2018 Notes URLs: Additional Info: OK: All targets OK ___ Betacluster-alerts mailing list

[Betacluster-alerts] ** PROBLEM alert - deployment-deploy01/Free space - all mounts is WARNING **

Notification Type: PROBLEM Service: Free space - all mounts Host: deployment-deploy01 Address: 10.68.23.38 State: WARNING Date/Time: Fri 09 Nov 07:25:57 UTC 2018 Notes URLs: Additional Info: WARNING: deployment-prep.deployment-deploy01.diskspace.root.byte_percentfree (<10.00%)

[Betacluster-alerts] beta-scap-eqiad - Build # 227213 - Fixed!

beta-scap-eqiad - Build # 227213 - Fixed: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/227213/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] beta-scap-eqiad - Build # 227212 - Failure!

beta-scap-eqiad - Build # 227212 - Failure: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/227212/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] ** RECOVERY alert - deployment-deploy01/Free space - all mounts is OK **

Notification Type: RECOVERY Service: Free space - all mounts Host: deployment-deploy01 Address: 10.68.23.38 State: OK Date/Time: Fri 09 Nov 04:14:59 UTC 2018 Notes URLs: Additional Info: OK: All targets OK ___ Betacluster-alerts mailing list

[Betacluster-alerts] beta-scap-eqiad - Build # 227203 - Fixed!

beta-scap-eqiad - Build # 227203 - Fixed: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/227203/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] beta-scap-eqiad - Build # 227202 - Still Failing!

beta-scap-eqiad - Build # 227202 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/227202/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] beta-scap-eqiad - Build # 227201 - Still Failing!

beta-scap-eqiad - Build # 227201 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/227201/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] beta-scap-eqiad - Build # 227200 - Still Failing!

beta-scap-eqiad - Build # 227200 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/227200/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] ** PROBLEM alert - deployment-deploy01/Free space - all mounts is WARNING **

Notification Type: PROBLEM Service: Free space - all mounts Host: deployment-deploy01 Address: 10.68.23.38 State: WARNING Date/Time: Fri 09 Nov 03:24:57 UTC 2018 Notes URLs: Additional Info: WARNING: deployment-prep.deployment-deploy01.diskspace.root.byte_percentfree (<40.00%)

[Betacluster-alerts] beta-scap-eqiad - Build # 227199 - Failure!

beta-scap-eqiad - Build # 227199 - Failure: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/227199/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] ** RECOVERY alert - deployment-deploy01/Free space - all mounts is OK **

Notification Type: RECOVERY Service: Free space - all mounts Host: deployment-deploy01 Address: 10.68.23.38 State: OK Date/Time: Fri 09 Nov 03:18:56 UTC 2018 Notes URLs: Additional Info: OK: All targets OK ___ Betacluster-alerts mailing list

[Betacluster-alerts] ** PROBLEM alert - deployment-deploy01/Free space - all mounts is WARNING **

Notification Type: PROBLEM Service: Free space - all mounts Host: deployment-deploy01 Address: 10.68.23.38 State: WARNING Date/Time: Fri 09 Nov 03:08:57 UTC 2018 Notes URLs: Additional Info: WARNING: deployment-prep.deployment-deploy01.diskspace.root.byte_percentfree (<10.00%)

[Betacluster-alerts] ** RECOVERY alert - Graphite Labs/Mediawiki Error Rate is OK **

Notification Type: RECOVERY Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: OK Date/Time: Fri 09 Nov 02:53:13 UTC 2018 Notes URLs: Additional Info: OK: Less than 1.00% above the threshold [1.0] ___

[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is WARNING **

Notification Type: PROBLEM Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: WARNING Date/Time: Fri 09 Nov 02:48:13 UTC 2018 Notes URLs: Additional Info: WARNING: 20.00% of data above the warning threshold [1.0]

[Betacluster-alerts] ** RECOVERY alert - deployment-deploy01/Free space - all mounts is OK **

Notification Type: RECOVERY Service: Free space - all mounts Host: deployment-deploy01 Address: 10.68.23.38 State: OK Date/Time: Fri 09 Nov 02:22:58 UTC 2018 Notes URLs: Additional Info: OK: All targets OK ___ Betacluster-alerts mailing list

[Betacluster-alerts] ** PROBLEM alert - deployment-deploy01/Free space - all mounts is WARNING **

Notification Type: PROBLEM Service: Free space - all mounts Host: deployment-deploy01 Address: 10.68.23.38 State: WARNING Date/Time: Fri 09 Nov 02:12:57 UTC 2018 Notes URLs: Additional Info: WARNING: deployment-prep.deployment-deploy01.diskspace.root.byte_percentfree (<10.00%)

[Betacluster-alerts] ** RECOVERY alert - deployment-deploy01/Free space - all mounts is OK **

Notification Type: RECOVERY Service: Free space - all mounts Host: deployment-deploy01 Address: 10.68.23.38 State: OK Date/Time: Fri 09 Nov 00:41:56 UTC 2018 Notes URLs: Additional Info: OK: All targets OK ___ Betacluster-alerts mailing list

[Betacluster-alerts] ** PROBLEM alert - deployment-deploy01/Free space - all mounts is WARNING **

Notification Type: PROBLEM Service: Free space - all mounts Host: deployment-deploy01 Address: 10.68.23.38 State: WARNING Date/Time: Fri 09 Nov 00:31:58 UTC 2018 Notes URLs: Additional Info: WARNING: deployment-prep.deployment-deploy01.diskspace.root.byte_percentfree (<10.00%)

[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is WARNING **

Notification Type: PROBLEM Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: WARNING Date/Time: Thu 08 Nov 21:52:13 UTC 2018 Notes URLs: Additional Info: WARNING: 20.00% of data above the warning threshold [1.0]

[Betacluster-alerts] ** RECOVERY alert - Graphite Labs/Mediawiki Error Rate is OK **

Notification Type: RECOVERY Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: OK Date/Time: Thu 08 Nov 21:41:12 UTC 2018 Notes URLs: Additional Info: OK: Less than 1.00% above the threshold [1.0] ___

[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is WARNING **

Notification Type: PROBLEM Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: WARNING Date/Time: Thu 08 Nov 21:36:12 UTC 2018 Notes URLs: Additional Info: WARNING: 20.00% of data above the warning threshold [1.0]

[Betacluster-alerts] ** RECOVERY alert - Graphite Labs/Mediawiki Error Rate is OK **

Notification Type: RECOVERY Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: OK Date/Time: Thu 08 Nov 20:50:13 UTC 2018 Notes URLs: Additional Info: OK: Less than 1.00% above the threshold [1.0] ___

[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is WARNING **

Notification Type: PROBLEM Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: WARNING Date/Time: Thu 08 Nov 20:45:14 UTC 2018 Notes URLs: Additional Info: WARNING: 20.00% of data above the warning threshold [1.0]

[Betacluster-alerts] ** RECOVERY alert - deployment-maps05/Puppet errors is OK **

Notification Type: RECOVERY Service: Puppet errors Host: deployment-maps05 Address: 10.68.16.223 State: OK Date/Time: Thu 08 Nov 19:53:33 UTC 2018 Notes URLs: Additional Info: OK: Less than 1.00% above the threshold [2.0] ___ Betacluster-alerts

[Betacluster-alerts] ** RECOVERY alert - deployment-deploy01/Free space - all mounts is OK **

Notification Type: RECOVERY Service: Free space - all mounts Host: deployment-deploy01 Address: 10.68.23.38 State: OK Date/Time: Thu 08 Nov 18:36:57 UTC 2018 Notes URLs: Additional Info: OK: All targets OK ___ Betacluster-alerts mailing list

[Betacluster-alerts] ** PROBLEM alert - deployment-deploy01/Free space - all mounts is CRITICAL **

Notification Type: PROBLEM Service: Free space - all mounts Host: deployment-deploy01 Address: 10.68.23.38 State: CRITICAL Date/Time: Thu 08 Nov 18:32:09 UTC 2018 Notes URLs: Additional Info: (Service Check Timed Out) ___ Betacluster-alerts

[Betacluster-alerts] ** PROBLEM alert - deployment-deploy01/Free space - all mounts is WARNING **

Notification Type: PROBLEM Service: Free space - all mounts Host: deployment-deploy01 Address: 10.68.23.38 State: WARNING Date/Time: Thu 08 Nov 18:26:58 UTC 2018 Notes URLs: Additional Info: WARNING: deployment-prep.deployment-deploy01.diskspace.root.byte_percentfree (<20.00%)

[Betacluster-alerts] ** RECOVERY alert - deployment-changeprop/Puppet staleness is OK **

Notification Type: RECOVERY Service: Puppet staleness Host: deployment-changeprop Address: 10.68.16.88 State: OK Date/Time: Thu 08 Nov 18:24:53 UTC 2018 Notes URLs: Additional Info: OK: Less than 1.00% above the threshold [3600.0] ___

[Betacluster-alerts] ** RECOVERY alert - deployment-ms-be04/Puppet staleness is OK **

Notification Type: RECOVERY Service: Puppet staleness Host: deployment-ms-be04 Address: 10.68.16.139 State: OK Date/Time: Thu 08 Nov 18:24:50 UTC 2018 Notes URLs: Additional Info: OK: Less than 1.00% above the threshold [3600.0] ___

[Betacluster-alerts] ** PROBLEM alert - deployment-changeprop/Puppet staleness is CRITICAL **

Notification Type: PROBLEM Service: Puppet staleness Host: deployment-changeprop Address: 10.68.16.88 State: CRITICAL Date/Time: Thu 08 Nov 18:20:02 UTC 2018 Notes URLs: Additional Info: (Service Check Timed Out) ___ Betacluster-alerts mailing

[Betacluster-alerts] ** PROBLEM alert - deployment-ms-be04/Puppet staleness is CRITICAL **

Notification Type: PROBLEM Service: Puppet staleness Host: deployment-ms-be04 Address: 10.68.16.139 State: CRITICAL Date/Time: Thu 08 Nov 18:19:58 UTC 2018 Notes URLs: Additional Info: (Service Check Timed Out) ___ Betacluster-alerts mailing list

[Betacluster-alerts] ** PROBLEM alert - deployment-maps05/Puppet errors is CRITICAL **

Notification Type: PROBLEM Service: Puppet errors Host: deployment-maps05 Address: 10.68.16.223 State: CRITICAL Date/Time: Thu 08 Nov 18:08:34 UTC 2018 Notes URLs: Additional Info: CRITICAL: 6.74% of data above the critical threshold [3.0] ___

[Betacluster-alerts] ** RECOVERY alert - deployment-deploy01/Free space - all mounts is OK **

Notification Type: RECOVERY Service: Free space - all mounts Host: deployment-deploy01 Address: 10.68.23.38 State: OK Date/Time: Thu 08 Nov 17:50:58 UTC 2018 Notes URLs: Additional Info: OK: All targets OK ___ Betacluster-alerts mailing list

[Betacluster-alerts] ** PROBLEM alert - deployment-deploy01/Free space - all mounts is WARNING **

Notification Type: PROBLEM Service: Free space - all mounts Host: deployment-deploy01 Address: 10.68.23.38 State: WARNING Date/Time: Thu 08 Nov 17:40:57 UTC 2018 Notes URLs: Additional Info: WARNING: deployment-prep.deployment-deploy01.diskspace.root.byte_percentfree (<10.00%)

[Betacluster-alerts] ** PROBLEM alert - deployment-puppetmaster03/Long lived cherry-picks on puppetmaster is CRITICAL **

Notification Type: PROBLEM Service: Long lived cherry-picks on puppetmaster Host: deployment-puppetmaster03 Address: 10.68.23.29 State: CRITICAL Date/Time: Thu 08 Nov 17:05:00 UTC 2018 Notes URLs: Additional Info: CRITICAL: 100.00% of data above the critical threshold [0.0]

[Betacluster-alerts] ** RECOVERY alert - deployment-deploy01/Free space - all mounts is OK **

Notification Type: RECOVERY Service: Free space - all mounts Host: deployment-deploy01 Address: 10.68.23.38 State: OK Date/Time: Thu 08 Nov 16:09:58 UTC 2018 Notes URLs: Additional Info: OK: All targets OK ___ Betacluster-alerts mailing list

[Betacluster-alerts] ** PROBLEM alert - deployment-deploy01/Free space - all mounts is WARNING **

Notification Type: PROBLEM Service: Free space - all mounts Host: deployment-deploy01 Address: 10.68.23.38 State: WARNING Date/Time: Thu 08 Nov 15:59:57 UTC 2018 Notes URLs: Additional Info: WARNING: deployment-prep.deployment-deploy01.diskspace.root.byte_percentfree (<10.00%)

[Betacluster-alerts] beta-code-update-eqiad - Build # 224428 - Failure!

beta-code-update-eqiad - Build # 224428 - Failure: Check console output at https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/224428/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] ** RECOVERY alert - deployment-deploy01/Free space - all mounts is OK **

Notification Type: RECOVERY Service: Free space - all mounts Host: deployment-deploy01 Address: 10.68.23.38 State: OK Date/Time: Thu 08 Nov 14:27:59 UTC 2018 Notes URLs: Additional Info: OK: All targets OK ___ Betacluster-alerts mailing list

[Betacluster-alerts] ** PROBLEM alert - deployment-deploy01/Free space - all mounts is WARNING **

Notification Type: PROBLEM Service: Free space - all mounts Host: deployment-deploy01 Address: 10.68.23.38 State: WARNING Date/Time: Thu 08 Nov 14:18:00 UTC 2018 Notes URLs: Additional Info: WARNING: deployment-prep.deployment-deploy01.diskspace.root.byte_percentfree (<10.00%)

[Betacluster-alerts] ** PROBLEM alert - deployment-rd3-cptest-master01/Puppet staleness is CRITICAL **

Notification Type: PROBLEM Service: Puppet staleness Host: deployment-rd3-cptest-master01 Address: 10.68.23.169 State: CRITICAL Date/Time: Thu 08 Nov 13:59:41 UTC 2018 Notes URLs: Additional Info: CRITICAL: 100.00% of data above the critical threshold [43200.0]

[Betacluster-alerts] beta-scap-eqiad - Build # 227147 - Fixed!

beta-scap-eqiad - Build # 227147 - Fixed: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/227147/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] beta-scap-eqiad - Build # 227146 - Failure!

beta-scap-eqiad - Build # 227146 - Failure: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/227146/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org