[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is WARNING **

Notification Type: PROBLEM Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: WARNING Date/Time: Mon 26 Aug 04:16:00 UTC 2019 Notes URLs: Acknowledged by : Additional Info: WARNING: 40.00% of data above the warning threshold [1.0]

[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is CRITICAL **

Notification Type: PROBLEM Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: CRITICAL Date/Time: Mon 26 Aug 04:11:01 UTC 2019 Notes URLs: Acknowledged by : Additional Info: CRITICAL: 20.00% of data above the critical threshold [10.0]

[Betacluster-alerts] ** PROBLEM alert - deployment-fluorine02/Free space - all mounts is CRITICAL **

Notification Type: PROBLEM Service: Free space - all mounts Host: deployment-fluorine02 Address: 172.16.5.71 State: CRITICAL Date/Time: Mon 26 Aug 02:16:45 UTC 2019 Notes URLs: Acknowledged by : Additional Info: CRITICAL:

[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is CRITICAL **

Notification Type: PROBLEM Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: CRITICAL Date/Time: Mon 26 Aug 02:11:02 UTC 2019 Notes URLs: Acknowledged by : Additional Info: CRITICAL: 20.00% of data above the critical threshold [10.0]

[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is CRITICAL **

Notification Type: PROBLEM Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: CRITICAL Date/Time: Mon 26 Aug 01:16:00 UTC 2019 Notes URLs: Acknowledged by : Additional Info: CRITICAL: 20.00% of data above the critical threshold [10.0]

[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is WARNING **

Notification Type: PROBLEM Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: WARNING Date/Time: Mon 26 Aug 01:06:02 UTC 2019 Notes URLs: Acknowledged by : Additional Info: WARNING: 20.00% of data above the warning threshold [1.0]

[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is CRITICAL **

Notification Type: PROBLEM Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: CRITICAL Date/Time: Mon 26 Aug 01:01:03 UTC 2019 Notes URLs: Acknowledged by : Additional Info: CRITICAL: 20.00% of data above the critical threshold [10.0]

[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is WARNING **

Notification Type: PROBLEM Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: WARNING Date/Time: Mon 26 Aug 00:16:02 UTC 2019 Notes URLs: Acknowledged by : Additional Info: WARNING: 40.00% of data above the warning threshold [1.0]

[Betacluster-alerts] ** PROBLEM alert - deployment-fluorine02/Free space - all mounts is WARNING **

Notification Type: PROBLEM Service: Free space - all mounts Host: deployment-fluorine02 Address: 172.16.5.71 State: WARNING Date/Time: Sun 25 Aug 23:36:44 UTC 2019 Notes URLs: Acknowledged by : Additional Info: WARNING: deployment-prep.deployment-fluorine02.diskspace._srv.byte_percentfree

[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is WARNING **

Notification Type: PROBLEM Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: WARNING Date/Time: Sun 25 Aug 22:16:01 UTC 2019 Notes URLs: Acknowledged by : Additional Info: WARNING: 60.00% of data above the warning threshold [1.0]

[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is CRITICAL **

Notification Type: PROBLEM Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: CRITICAL Date/Time: Sun 25 Aug 22:11:03 UTC 2019 Notes URLs: Acknowledged by : Additional Info: CRITICAL: 20.00% of data above the critical threshold [10.0]

[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is WARNING **

Notification Type: PROBLEM Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: WARNING Date/Time: Sun 25 Aug 20:16:01 UTC 2019 Notes URLs: Acknowledged by : Additional Info: WARNING: 40.00% of data above the warning threshold [1.0]

[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is CRITICAL **

Notification Type: PROBLEM Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: CRITICAL Date/Time: Sun 25 Aug 20:11:02 UTC 2019 Notes URLs: Acknowledged by : Additional Info: CRITICAL: 20.00% of data above the critical threshold [10.0]

[Betacluster-alerts] ** PROBLEM alert - deployment-deploy01/Free space - all mounts is WARNING **

Notification Type: PROBLEM Service: Free space - all mounts Host: deployment-deploy01 Address: 172.16.4.18 State: WARNING Date/Time: Sun 25 Aug 18:28:39 UTC 2019 Notes URLs: Acknowledged by : Additional Info: WARNING: deployment-prep.deployment-deploy01.diskspace.root.byte_percentfree

[Betacluster-alerts] ** PROBLEM alert - deployment-mediawiki-jhuneidi/App Server Main HTTP Response is CRITICAL **

Notification Type: PROBLEM Service: App Server Main HTTP Response Host: deployment-mediawiki-jhuneidi Address: 172.16.6.25 State: CRITICAL Date/Time: Sun 25 Aug 18:20:20 UTC 2019 Notes URLs: Acknowledged by : Additional Info: HTTP CRITICAL: HTTP/1.1 404 Not Found - string 'Wikipedia' not

[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is WARNING **

Notification Type: PROBLEM Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: WARNING Date/Time: Sun 25 Aug 18:16:00 UTC 2019 Notes URLs: Acknowledged by : Additional Info: WARNING: 40.00% of data above the warning threshold [1.0]

[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is CRITICAL **

Notification Type: PROBLEM Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: CRITICAL Date/Time: Sun 25 Aug 18:11:03 UTC 2019 Notes URLs: Acknowledged by : Additional Info: CRITICAL: 20.00% of data above the critical threshold [10.0]

[Betacluster-alerts] beta-scap-eqiad - Build # 264016 - Fixed!

beta-scap-eqiad - Build # 264016 - Fixed: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/264016/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] beta-scap-eqiad - Build # 264015 - Failure!

beta-scap-eqiad - Build # 264015 - Failure: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/264015/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] ** RECOVERY alert - Generic Beta Cluster/English Wikipedia Main page is OK **

Notification Type: RECOVERY Service: English Wikipedia Main page Host: Generic Beta Cluster Address: en.wikipedia.beta.wmflabs.org State: OK Date/Time: Sun 25 Aug 16:31:51 UTC 2019 Notes URLs: Acknowledged by : Additional Info: HTTP OK: HTTP/1.1 200 OK - 48785 bytes in 0.630 second

[Betacluster-alerts] ** RECOVERY alert - deployment-mediawiki-07/App Server Main HTTP Response is OK **

Notification Type: RECOVERY Service: App Server Main HTTP Response Host: deployment-mediawiki-07 Address: 172.16.4.119 State: OK Date/Time: Sun 25 Aug 16:30:16 UTC 2019 Notes URLs: Acknowledged by : Additional Info: HTTP OK: HTTP/1.1 200 OK - 48249 bytes in 0.445 second response time

[Betacluster-alerts] ** RECOVERY alert - Generic Beta Cluster/English Wikipedia Mobile Main page is OK **

Notification Type: RECOVERY Service: English Wikipedia Mobile Main page Host: Generic Beta Cluster Address: en.wikipedia.beta.wmflabs.org State: OK Date/Time: Sun 25 Aug 16:30:26 UTC 2019 Notes URLs: Acknowledged by : Additional Info: HTTP OK: HTTP/1.1 200 OK - 36973 bytes in 0.641 second

[Betacluster-alerts] ** RECOVERY alert - deployment-mediawiki-09/App Server Main HTTP Response is OK **

Notification Type: RECOVERY Service: App Server Main HTTP Response Host: deployment-mediawiki-09 Address: 172.16.4.106 State: OK Date/Time: Sun 25 Aug 16:30:12 UTC 2019 Notes URLs: Acknowledged by : Additional Info: HTTP OK: HTTP/1.1 200 OK - 48245 bytes in 3.588 second response time

[Betacluster-alerts] ** PROBLEM alert - Generic Beta Cluster/English Wikipedia Main page is CRITICAL **

Notification Type: PROBLEM Service: English Wikipedia Main page Host: Generic Beta Cluster Address: en.wikipedia.beta.wmflabs.org State: CRITICAL Date/Time: Sun 25 Aug 13:56:51 UTC 2019 Notes URLs: Acknowledged by : Additional Info: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error -

[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is CRITICAL **

Notification Type: PROBLEM Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: CRITICAL Date/Time: Sun 25 Aug 13:56:02 UTC 2019 Notes URLs: Acknowledged by : Additional Info: CRITICAL: 40.00% of data above the critical threshold [10.0]

[Betacluster-alerts] ** PROBLEM alert - Generic Beta Cluster/English Wikipedia Mobile Main page is CRITICAL **

Notification Type: PROBLEM Service: English Wikipedia Mobile Main page Host: Generic Beta Cluster Address: en.wikipedia.beta.wmflabs.org State: CRITICAL Date/Time: Sun 25 Aug 13:55:28 UTC 2019 Notes URLs: Acknowledged by : Additional Info: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error

[Betacluster-alerts] ** PROBLEM alert - deployment-mediawiki-07/App Server Main HTTP Response is CRITICAL **

Notification Type: PROBLEM Service: App Server Main HTTP Response Host: deployment-mediawiki-07 Address: 172.16.4.119 State: CRITICAL Date/Time: Sun 25 Aug 13:55:16 UTC 2019 Notes URLs: Acknowledged by : Additional Info: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - string

[Betacluster-alerts] ** PROBLEM alert - deployment-mediawiki-09/App Server Main HTTP Response is CRITICAL **

Notification Type: PROBLEM Service: App Server Main HTTP Response Host: deployment-mediawiki-09 Address: 172.16.4.106 State: CRITICAL Date/Time: Sun 25 Aug 13:55:12 UTC 2019 Notes URLs: Acknowledged by : Additional Info: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - string

[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is CRITICAL **

Notification Type: PROBLEM Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: CRITICAL Date/Time: Sun 25 Aug 11:21:03 UTC 2019 Notes URLs: Acknowledged by : Additional Info: CRITICAL: 20.00% of data above the critical threshold [10.0]

[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is WARNING **

Notification Type: PROBLEM Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: WARNING Date/Time: Sun 25 Aug 10:46:03 UTC 2019 Notes URLs: Acknowledged by : Additional Info: WARNING: 60.00% of data above the warning threshold [1.0]

[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is CRITICAL **

Notification Type: PROBLEM Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: CRITICAL Date/Time: Sun 25 Aug 10:41:02 UTC 2019 Notes URLs: Acknowledged by : Additional Info: CRITICAL: 20.00% of data above the critical threshold [10.0]

[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is WARNING **

Notification Type: PROBLEM Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: WARNING Date/Time: Sun 25 Aug 10:16:02 UTC 2019 Notes URLs: Acknowledged by : Additional Info: WARNING: 80.00% of data above the warning threshold [1.0]

[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is CRITICAL **

Notification Type: PROBLEM Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: CRITICAL Date/Time: Sun 25 Aug 10:11:01 UTC 2019 Notes URLs: Acknowledged by : Additional Info: CRITICAL: 20.00% of data above the critical threshold [10.0]

[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is WARNING **

Notification Type: PROBLEM Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: WARNING Date/Time: Sun 25 Aug 08:16:01 UTC 2019 Notes URLs: Acknowledged by : Additional Info: WARNING: 80.00% of data above the warning threshold [1.0]

[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is CRITICAL **

Notification Type: PROBLEM Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: CRITICAL Date/Time: Sun 25 Aug 08:11:02 UTC 2019 Notes URLs: Acknowledged by : Additional Info: CRITICAL: 20.00% of data above the critical threshold [10.0]

[Betacluster-alerts] selenium-daily-beta-MediaWiki - Build # 376 - Failure!

FAILURE: selenium-daily-beta-MediaWiki Build #376 (Sun, 25 Aug 2019 07:40:00 +) Test Result 2 failed, 0 skipped Failed Tests Test NameDurationAge chrome.Page.should_be_editable_daily1.4 sec1

[Betacluster-alerts] ** RECOVERY alert - deployment-fluorine02/Free space - all mounts is OK **

Notification Type: RECOVERY Service: Free space - all mounts Host: deployment-fluorine02 Address: 172.16.5.71 State: OK Date/Time: Sun 25 Aug 06:55:44 UTC 2019 Notes URLs: Acknowledged by : Additional Info: OK: All targets OK ___