[Betacluster-alerts] ** RECOVERY alert - deployment-fluorine02/Free space - all mounts is OK **

Notification Type: RECOVERY Service: Free space - all mounts Host: deployment-fluorine02 Address: 10.68.23.106 State: OK Date/Time: Fri 19 Jan 06:48:39 UTC 2018 Notes URLs: Additional Info: OK: All targets OK ___ Betacluster-alerts mailing list

[Betacluster-alerts] ** PROBLEM alert - deployment-fluorine02/Free space - all mounts is CRITICAL **

Notification Type: PROBLEM Service: Free space - all mounts Host: deployment-fluorine02 Address: 10.68.23.106 State: CRITICAL Date/Time: Fri 19 Jan 02:18:40 UTC 2018 Notes URLs: Additional Info: CRITICAL: deployment-prep.deployment-fluorine02.diskspace._srv.byte_percentfree (<33.33%)

[Betacluster-alerts] ** PROBLEM alert - deployment-fluorine02/Free space - all mounts is WARNING **

Notification Type: PROBLEM Service: Free space - all mounts Host: deployment-fluorine02 Address: 10.68.23.106 State: WARNING Date/Time: Thu 18 Jan 23:28:37 UTC 2018 Notes URLs: Additional Info: WARNING: deployment-prep.deployment-fluorine02.diskspace._srv.byte_percentfree (<22.22%)

[Betacluster-alerts] ** PROBLEM alert - deployment-mx02/Puppet errors is CRITICAL **

Notification Type: PROBLEM Service: Puppet errors Host: deployment-mx02 Address: 10.68.23.220 State: CRITICAL Date/Time: Thu 18 Jan 21:08:21 UTC 2018 Notes URLs: Additional Info: CRITICAL: 100.00% of data above the critical threshold [0.0] ___

[Betacluster-alerts] ** RECOVERY alert - Graphite Labs/Mediawiki Error Rate is OK **

Notification Type: RECOVERY Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: OK Date/Time: Thu 18 Jan 19:58:28 UTC 2018 Notes URLs: Additional Info: OK: Less than 1.00% above the threshold [1.0] ___

[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is WARNING **

Notification Type: PROBLEM Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: WARNING Date/Time: Thu 18 Jan 19:53:30 UTC 2018 Notes URLs: Additional Info: WARNING: 20.00% of data above the warning threshold [1.0]

[Betacluster-alerts] ** RECOVERY alert - Graphite Labs/Mediawiki Error Rate is OK **

Notification Type: RECOVERY Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: OK Date/Time: Thu 18 Jan 19:37:30 UTC 2018 Notes URLs: Additional Info: OK: Less than 1.00% above the threshold [1.0] ___

[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is WARNING **

Notification Type: PROBLEM Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: WARNING Date/Time: Thu 18 Jan 19:32:31 UTC 2018 Notes URLs: Additional Info: WARNING: 20.00% of data above the warning threshold [1.0]

[Betacluster-alerts] ** PROBLEM alert - deployment-secureredirexperiment/Puppet errors is CRITICAL **

Notification Type: PROBLEM Service: Puppet errors Host: deployment-secureredirexperiment Address: 10.68.17.132 State: CRITICAL Date/Time: Thu 18 Jan 18:54:27 UTC 2018 Notes URLs: Additional Info: CRITICAL: 100.00% of data above the critical threshold [0.0]

[Betacluster-alerts] ** PROBLEM alert - deployment-snapshot01/Puppet errors is CRITICAL **

Notification Type: PROBLEM Service: Puppet errors Host: deployment-snapshot01 Address: 10.68.19.94 State: CRITICAL Date/Time: Thu 18 Jan 17:28:46 UTC 2018 Notes URLs: Additional Info: CRITICAL: 100.00% of data above the critical threshold [0.0] ___

[Betacluster-alerts] ** PROBLEM alert - deployment-logstash2/Puppet errors is CRITICAL **

Notification Type: PROBLEM Service: Puppet errors Host: deployment-logstash2 Address: 10.68.16.147 State: CRITICAL Date/Time: Thu 18 Jan 16:33:16 UTC 2018 Notes URLs: Additional Info: CRITICAL: 55.56% of data above the critical threshold [0.0] ___

[Betacluster-alerts] Host DOWN alert for deployment-kafka01!

Notification Type: PROBLEM Host: deployment-kafka01 State: DOWN Address: 10.68.21.219 Info: CRITICAL - Host Unreachable (10.68.21.219) Date/Time: Thu 18 Jan 16:02:24 UTC 2018 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] Host DOWN alert for deployment-kafka03!

Notification Type: PROBLEM Host: deployment-kafka03 State: DOWN Address: 10.68.16.138 Info: CRITICAL - Host Unreachable (10.68.16.138) Date/Time: Thu 18 Jan 16:01:17 UTC 2018 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] ** RECOVERY alert - Graphite Labs/Mediawiki Error Rate is OK **

Notification Type: RECOVERY Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: OK Date/Time: Thu 18 Jan 15:16:29 UTC 2018 Notes URLs: Additional Info: OK: Less than 1.00% above the threshold [1.0] ___

[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is WARNING **

Notification Type: PROBLEM Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: WARNING Date/Time: Thu 18 Jan 15:11:31 UTC 2018 Notes URLs: Additional Info: WARNING: 20.00% of data above the warning threshold [1.0]

[Betacluster-alerts] ** RECOVERY alert - deployment-mediawiki05/Free space - all mounts is OK **

Notification Type: RECOVERY Service: Free space - all mounts Host: deployment-mediawiki05 Address: 10.68.22.21 State: OK Date/Time: Thu 18 Jan 15:04:48 UTC 2018 Notes URLs: Additional Info: OK: All targets OK ___ Betacluster-alerts mailing list

[Betacluster-alerts] beta-scap-eqiad - Build # 191406 - Fixed!

beta-scap-eqiad - Build # 191406 - Fixed: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/191406/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] Host DOWN alert for deployment-puppetdb01!

Notification Type: PROBLEM Host: deployment-puppetdb01 State: DOWN Address: 10.68.23.76 Info: CRITICAL - Host Unreachable (10.68.23.76) Date/Time: Thu 18 Jan 14:53:14 UTC 2018 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] beta-scap-eqiad - Build # 191405 - Still Failing!

beta-scap-eqiad - Build # 191405 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/191405/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] beta-scap-eqiad - Build # 191404 - Still Failing!

beta-scap-eqiad - Build # 191404 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/191404/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] beta-scap-eqiad - Build # 191403 - Still Failing!

beta-scap-eqiad - Build # 191403 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/191403/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] beta-scap-eqiad - Build # 191402 - Still Failing!

beta-scap-eqiad - Build # 191402 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/191402/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] beta-scap-eqiad - Build # 191401 - Still Failing!

beta-scap-eqiad - Build # 191401 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/191401/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] beta-scap-eqiad - Build # 191400 - Still Failing!

beta-scap-eqiad - Build # 191400 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/191400/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] beta-scap-eqiad - Build # 191399 - Still Failing!

beta-scap-eqiad - Build # 191399 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/191399/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] beta-scap-eqiad - Build # 191398 - Still Failing!

beta-scap-eqiad - Build # 191398 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/191398/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] beta-scap-eqiad - Build # 191397 - Still Failing!

beta-scap-eqiad - Build # 191397 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/191397/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] beta-scap-eqiad - Build # 191396 - Still Failing!

beta-scap-eqiad - Build # 191396 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/191396/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] beta-scap-eqiad - Build # 191395 - Still Failing!

beta-scap-eqiad - Build # 191395 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/191395/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] beta-scap-eqiad - Build # 191394 - Still Failing!

beta-scap-eqiad - Build # 191394 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/191394/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] beta-scap-eqiad - Build # 191393 - Still Failing!

beta-scap-eqiad - Build # 191393 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/191393/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] beta-scap-eqiad - Build # 191392 - Still Failing!

beta-scap-eqiad - Build # 191392 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/191392/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] beta-scap-eqiad - Build # 191391 - Still Failing!

beta-scap-eqiad - Build # 191391 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/191391/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] beta-scap-eqiad - Build # 191390 - Still Failing!

beta-scap-eqiad - Build # 191390 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/191390/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] beta-scap-eqiad - Build # 191389 - Still Failing!

beta-scap-eqiad - Build # 191389 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/191389/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] beta-scap-eqiad - Build # 191387 - Still Failing!

beta-scap-eqiad - Build # 191387 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/191387/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] beta-scap-eqiad - Build # 191386 - Still Failing!

beta-scap-eqiad - Build # 191386 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/191386/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] beta-scap-eqiad - Build # 191385 - Still Failing!

beta-scap-eqiad - Build # 191385 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/191385/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] beta-scap-eqiad - Build # 191384 - Still Failing!

beta-scap-eqiad - Build # 191384 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/191384/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] beta-scap-eqiad - Build # 191383 - Failure!

beta-scap-eqiad - Build # 191383 - Failure: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/191383/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] ** PROBLEM alert - deployment-mediawiki05/Free space - all mounts is CRITICAL **

Notification Type: PROBLEM Service: Free space - all mounts Host: deployment-mediawiki05 Address: 10.68.22.21 State: CRITICAL Date/Time: Thu 18 Jan 11:49:47 UTC 2018 Notes URLs: Additional Info: CRITICAL: deployment-prep.deployment-mediawiki05.diskspace.root.byte_percentfree (<55.56%)