[Betacluster-alerts] Host UP alert for deployment-urldownloader02!
Notification Type: RECOVERY Host: deployment-urldownloader02 State: UP Address: 172.16.4.11 Info: PING OK - Packet loss = 0%, RTA = 0.63 ms Date/Time: Mon 22 Jul 18:24:20 UTC 2019 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] Host DOWN alert for deployment-urldownloader02!
Notification Type: PROBLEM Host: deployment-urldownloader02 State: DOWN Address: 172.16.4.11 Info: CRITICAL - Host Unreachable (172.16.4.11) Date/Time: Mon 22 Jul 18:19:21 UTC 2019 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - Graphite Labs/Mediawiki Error Rate is OK **
Notification Type: RECOVERY Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: OK Date/Time: Mon 22 Jul 18:14:32 UTC 2019 Notes URLs: Additional Info: OK: Less than 1.00% above the threshold [1.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] Host UP alert for deployment-ores01!
Notification Type: RECOVERY Host: deployment-ores01 State: UP Address: 172.16.4.95 Info: PING OK - Packet loss = 0%, RTA = 4.51 ms Date/Time: Mon 22 Jul 18:12:09 UTC 2019 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is WARNING **
Notification Type: PROBLEM Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: WARNING Date/Time: Mon 22 Jul 18:09:32 UTC 2019 Notes URLs: Additional Info: WARNING: 20.00% of data above the warning threshold [1.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] Host DOWN alert for deployment-ores01!
Notification Type: PROBLEM Host: deployment-ores01 State: DOWN Address: 172.16.4.95 Info: CRITICAL - Host Unreachable (172.16.4.95) Date/Time: Mon 22 Jul 18:06:31 UTC 2019 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] Host UP alert for deployment-logstash2!
Notification Type: RECOVERY Host: deployment-logstash2 State: UP Address: 172.16.5.22 Info: PING OK - Packet loss = 0%, RTA = 0.78 ms Date/Time: Mon 22 Jul 17:59:44 UTC 2019 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] beta-scap-eqiad - Build # 258966 - Fixed!
beta-scap-eqiad - Build # 258966 - Fixed: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/258966/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] Host DOWN alert for deployment-logstash2!
Notification Type: PROBLEM Host: deployment-logstash2 State: DOWN Address: 172.16.5.22 Info: CRITICAL - Host Unreachable (172.16.5.22) Date/Time: Mon 22 Jul 17:44:44 UTC 2019 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] Host UP alert for deployment-jobrunner03!
Notification Type: RECOVERY Host: deployment-jobrunner03 State: UP Address: 172.16.4.98 Info: PING OK - Packet loss = 0%, RTA = 0.63 ms Date/Time: Mon 22 Jul 17:39:17 UTC 2019 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] beta-scap-eqiad - Build # 258965 - Still Failing!
beta-scap-eqiad - Build # 258965 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/258965/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] Host DOWN alert for deployment-jobrunner03!
Notification Type: PROBLEM Host: deployment-jobrunner03 State: DOWN Address: 172.16.4.98 Info: CRITICAL - Host Unreachable (172.16.4.98) Date/Time: Mon 22 Jul 17:31:30 UTC 2019 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-jobrunner03/SSH is CRITICAL **
Notification Type: PROBLEM Service: SSH Host: deployment-jobrunner03 Address: 172.16.4.98 State: CRITICAL Date/Time: Mon 22 Jul 17:27:39 UTC 2019 Notes URLs: Additional Info: CRITICAL - Socket timeout after 10 seconds ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] beta-scap-eqiad - Build # 258964 - Failure!
beta-scap-eqiad - Build # 258964 - Failure: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/258964/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-mwmaint01/Free space - all mounts is OK **
Notification Type: RECOVERY Service: Free space - all mounts Host: deployment-mwmaint01 Address: 172.16.4.16 State: OK Date/Time: Mon 22 Jul 17:21:31 UTC 2019 Notes URLs: Additional Info: OK: All targets OK ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-deploy01/Free space - all mounts is OK **
Notification Type: RECOVERY Service: Free space - all mounts Host: deployment-deploy01 Address: 172.16.4.18 State: OK Date/Time: Mon 22 Jul 17:17:50 UTC 2019 Notes URLs: Additional Info: OK: All targets OK ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] beta-scap-eqiad - Build # 258962 - Fixed!
beta-scap-eqiad - Build # 258962 - Fixed: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/258962/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-mwmaint01/Free space - all mounts is WARNING **
Notification Type: PROBLEM Service: Free space - all mounts Host: deployment-mwmaint01 Address: 172.16.4.16 State: WARNING Date/Time: Mon 22 Jul 17:11:30 UTC 2019 Notes URLs: Additional Info: WARNING: deployment-prep.deployment-mwmaint01.diskspace.root.byte_percentfree (<11.11%) ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] beta-scap-eqiad - Build # 258961 - Still Failing!
beta-scap-eqiad - Build # 258961 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/258961/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] beta-scap-eqiad - Build # 258960 - Failure!
beta-scap-eqiad - Build # 258960 - Failure: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/258960/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-deploy01/Free space - all mounts is WARNING **
Notification Type: PROBLEM Service: Free space - all mounts Host: deployment-deploy01 Address: 172.16.4.18 State: WARNING Date/Time: Mon 22 Jul 15:48:08 UTC 2019 Notes URLs: Additional Info: WARNING: deployment-prep.deployment-deploy01.diskspace.root.byte_percentfree (<11.11%) ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-deploy01/Free space - all mounts is OK **
Notification Type: RECOVERY Service: Free space - all mounts Host: deployment-deploy01 Address: 172.16.4.18 State: OK Date/Time: Mon 22 Jul 15:37:08 UTC 2019 Notes URLs: Additional Info: OK: All targets OK ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-deploy01/Free space - all mounts is WARNING **
Notification Type: PROBLEM Service: Free space - all mounts Host: deployment-deploy01 Address: 172.16.4.18 State: WARNING Date/Time: Mon 22 Jul 15:27:10 UTC 2019 Notes URLs: Additional Info: WARNING: deployment-prep.deployment-deploy01.diskspace.root.byte_percentfree (<11.11%) ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-deploy01/Free space - all mounts is OK **
Notification Type: RECOVERY Service: Free space - all mounts Host: deployment-deploy01 Address: 172.16.4.18 State: OK Date/Time: Mon 22 Jul 15:16:08 UTC 2019 Notes URLs: Additional Info: OK: All targets OK ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-mwmaint01/Free space - all mounts is OK **
Notification Type: RECOVERY Service: Free space - all mounts Host: deployment-mwmaint01 Address: 172.16.4.16 State: OK Date/Time: Mon 22 Jul 11:00:14 UTC 2019 Notes URLs: Additional Info: OK: All targets OK ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-mwmaint01/Free space - all mounts is WARNING **
Notification Type: PROBLEM Service: Free space - all mounts Host: deployment-mwmaint01 Address: 172.16.4.16 State: WARNING Date/Time: Mon 22 Jul 10:50:13 UTC 2019 Notes URLs: Additional Info: WARNING: deployment-prep.deployment-mwmaint01.diskspace.root.byte_percentfree (<11.11%) ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-deploy01/Free space - all mounts is WARNING **
Notification Type: PROBLEM Service: Free space - all mounts Host: deployment-deploy01 Address: 172.16.4.18 State: WARNING Date/Time: Mon 22 Jul 09:10:07 UTC 2019 Notes URLs: Additional Info: WARNING: deployment-prep.deployment-deploy01.diskspace.root.byte_percentfree (<11.11%) ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-deploy01/Free space - all mounts is OK **
Notification Type: RECOVERY Service: Free space - all mounts Host: deployment-deploy01 Address: 172.16.4.18 State: OK Date/Time: Mon 22 Jul 08:49:06 UTC 2019 Notes URLs: Additional Info: OK: All targets OK ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-deploy01/Free space - all mounts is WARNING **
Notification Type: PROBLEM Service: Free space - all mounts Host: deployment-deploy01 Address: 172.16.4.18 State: WARNING Date/Time: Mon 22 Jul 08:39:07 UTC 2019 Notes URLs: Additional Info: WARNING: deployment-prep.deployment-deploy01.diskspace.root.byte_percentfree (<11.11%) ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-deploy01/Free space - all mounts is OK **
Notification Type: RECOVERY Service: Free space - all mounts Host: deployment-deploy01 Address: 172.16.4.18 State: OK Date/Time: Mon 22 Jul 08:18:07 UTC 2019 Notes URLs: Additional Info: OK: All targets OK ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-deploy01/Free space - all mounts is WARNING **
Notification Type: PROBLEM Service: Free space - all mounts Host: deployment-deploy01 Address: 172.16.4.18 State: WARNING Date/Time: Mon 22 Jul 08:08:08 UTC 2019 Notes URLs: Additional Info: WARNING: deployment-prep.deployment-deploy01.diskspace.root.byte_percentfree (<11.11%) ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-fluorine02/Free space - all mounts is OK **
Notification Type: RECOVERY Service: Free space - all mounts Host: deployment-fluorine02 Address: 172.16.5.71 State: OK Date/Time: Mon 22 Jul 07:03:03 UTC 2019 Notes URLs: Additional Info: OK: All targets OK ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
