beta-code-update-eqiad - Build # 195942 - Failure:
Check console output at https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/195942/ to view the results.___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
Notification Type: PROBLEM
Service: Mediawiki Error Rate
Host: Graphite Labs
Address: graphite-labs.wikimedia.org
State: CRITICAL
Date/Time: Thu 01 Mar 09:35:32 UTC 2018
Notes URLs:
Additional Info:
CRITICAL: 40.00% of data above the critical threshold [10.0]
Notification Type: RECOVERY
Service: Mediawiki Error Rate
Host: Graphite Labs
Address: graphite-labs.wikimedia.org
State: OK
Date/Time: Thu 01 Mar 10:10:28 UTC 2018
Notes URLs:
Additional Info:
OK: Less than 1.00% above the threshold [1.0]
___
Notification Type: RECOVERY
Service: Puppet errors
Host: deployment-cache-text04
Address: 10.68.18.103
State: OK
Date/Time: Thu 01 Mar 08:15:44 UTC 2018
Notes URLs:
Additional Info:
OK: Less than 1.00% above the threshold [0.0]
___
Notification Type: PROBLEM
Service: Puppet errors
Host: deployment-ores01
Address: 10.68.23.165
State: CRITICAL
Date/Time: Thu 01 Mar 12:30:52 UTC 2018
Notes URLs:
Additional Info:
CRITICAL: 100.00% of data above the critical threshold [0.0]
___
Notification Type: PROBLEM
Host: deployment-videoscaler01
State: DOWN
Address: 10.68.19.130
Info: CRITICAL - Host Unreachable (10.68.19.130)
Date/Time: Thu 01 Mar 10:54:06 UTC 2018
___
Betacluster-alerts mailing list
Notification Type: PROBLEM
Host: deployment-tmh01
State: DOWN
Address: 10.68.16.211
Info: CRITICAL - Host Unreachable (10.68.16.211)
Date/Time: Thu 01 Mar 10:54:51 UTC 2018
___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
Notification Type: PROBLEM
Service: Mediawiki Error Rate
Host: Graphite Labs
Address: graphite-labs.wikimedia.org
State: WARNING
Date/Time: Thu 01 Mar 11:41:31 UTC 2018
Notes URLs:
Additional Info:
WARNING: 20.00% of data above the warning threshold [1.0]
Notification Type: RECOVERY
Service: Mediawiki Error Rate
Host: Graphite Labs
Address: graphite-labs.wikimedia.org
State: OK
Date/Time: Thu 01 Mar 11:46:28 UTC 2018
Notes URLs:
Additional Info:
OK: Less than 1.00% above the threshold [1.0]
___
Notification Type: PROBLEM
Host: deployment-puppetdb01
State: DOWN
Address: 10.68.23.76
Info: CRITICAL - Host Unreachable (10.68.23.76)
Date/Time: Thu 01 Mar 14:53:14 UTC 2018
___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
Notification Type: PROBLEM
Service: Puppet errors
Host: deployment-logstash2
Address: 10.68.16.147
State: CRITICAL
Date/Time: Thu 01 Mar 16:33:16 UTC 2018
Notes URLs:
Additional Info:
CRITICAL: 100.00% of data above the critical threshold [0.0]
___
Notification Type: PROBLEM
Service: Puppet errors
Host: deployment-cache-upload04
Address: 10.68.18.109
State: CRITICAL
Date/Time: Thu 01 Mar 15:58:40 UTC 2018
Notes URLs:
Additional Info:
CRITICAL: 22.22% of data above the critical threshold [0.0]
Notification Type: PROBLEM
Host: deployment-eventlog02
State: DOWN
Address: 10.68.18.138
Info: CRITICAL - Host Unreachable (10.68.18.138)
Date/Time: Thu 01 Mar 14:57:23 UTC 2018
___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
Notification Type: PROBLEM
Service: Mediawiki Error Rate
Host: Graphite Labs
Address: graphite-labs.wikimedia.org
State: WARNING
Date/Time: Thu 01 Mar 14:57:29 UTC 2018
Notes URLs:
Additional Info:
WARNING: 20.00% of data above the warning threshold [1.0]
Notification Type: RECOVERY
Service: Mediawiki Error Rate
Host: Graphite Labs
Address: graphite-labs.wikimedia.org
State: OK
Date/Time: Thu 01 Mar 15:07:29 UTC 2018
Notes URLs:
Additional Info:
OK: Less than 1.00% above the threshold [1.0]
___
Notification Type: RECOVERY
Service: Mediawiki Error Rate
Host: Graphite Labs
Address: graphite-labs.wikimedia.org
State: OK
Date/Time: Thu 01 Mar 20:46:30 UTC 2018
Notes URLs:
Additional Info:
OK: Less than 1.00% above the threshold [1.0]
___
Notification Type: RECOVERY
Service: Mediawiki Error Rate
Host: Graphite Labs
Address: graphite-labs.wikimedia.org
State: OK
Date/Time: Thu 01 Mar 19:09:29 UTC 2018
Notes URLs:
Additional Info:
OK: Less than 1.00% above the threshold [1.0]
___
Notification Type: PROBLEM
Service: Puppet errors
Host: deployment-mx02
Address: 10.68.23.220
State: CRITICAL
Date/Time: Thu 01 Mar 21:08:21 UTC 2018
Notes URLs:
Additional Info:
CRITICAL: 100.00% of data above the critical threshold [0.0]
___
Notification Type: PROBLEM
Service: Free space - all mounts
Host: deployment-mediawiki05
Address: 10.68.22.21
State: CRITICAL
Date/Time: Thu 01 Mar 20:02:47 UTC 2018
Notes URLs:
Additional Info:
CRITICAL:
deployment-prep.deployment-mediawiki05.diskspace.root.byte_percentfree (<11.11%)
Notification Type: PROBLEM
Service: Mediawiki Error Rate
Host: Graphite Labs
Address: graphite-labs.wikimedia.org
State: WARNING
Date/Time: Thu 01 Mar 18:23:30 UTC 2018
Notes URLs:
Additional Info:
WARNING: 20.00% of data above the warning threshold [1.0]
Notification Type: PROBLEM
Service: App Server Main HTTP Response
Host: deployment-mediawiki07
Address: 10.68.17.40
State: CRITICAL
Date/Time: Thu 01 Mar 18:34:35 UTC 2018
Notes URLs:
Additional Info:
HTTP CRITICAL: HTTP/1.1 500 hphp_invoke - string 'Wikipedia' not found on
Notification Type: PROBLEM
Service: Puppet errors
Host: deployment-secureredirexperiment
Address: 10.68.17.132
State: CRITICAL
Date/Time: Thu 01 Mar 18:54:27 UTC 2018
Notes URLs:
Additional Info:
CRITICAL: 100.00% of data above the critical threshold [0.0]
Notification Type: PROBLEM
Service: Mediawiki Error Rate
Host: Graphite Labs
Address: graphite-labs.wikimedia.org
State: WARNING
Date/Time: Thu 01 Mar 20:31:29 UTC 2018
Notes URLs:
Additional Info:
WARNING: 40.00% of data above the warning threshold [1.0]
Notification Type: PROBLEM
Service: Mediawiki Error Rate
Host: Graphite Labs
Address: graphite-labs.wikimedia.org
State: WARNING
Date/Time: Thu 01 Mar 19:20:31 UTC 2018
Notes URLs:
Additional Info:
WARNING: 40.00% of data above the warning threshold [1.0]
Notification Type: PROBLEM
Service: Free space - all mounts
Host: deployment-tin
Address: 10.68.21.205
State: WARNING
Date/Time: Thu 01 Mar 20:07:39 UTC 2018
Notes URLs:
Additional Info:
WARNING: deployment-prep.deployment-tin.diskspace._mnt.byte_percentfree (No
valid datapoints
Notification Type: RECOVERY
Service: Free space - all mounts
Host: deployment-mediawiki05
Address: 10.68.22.21
State: OK
Date/Time: Thu 01 Mar 20:07:49 UTC 2018
Notes URLs:
Additional Info:
OK: All targets OK
___
Betacluster-alerts mailing list
Notification Type: PROBLEM
Service: Mediawiki Error Rate
Host: Graphite Labs
Address: graphite-labs.wikimedia.org
State: WARNING
Date/Time: Thu 01 Mar 18:54:29 UTC 2018
Notes URLs:
Additional Info:
WARNING: 80.00% of data above the warning threshold [1.0]
Notification Type: PROBLEM
Service: Free space - all mounts
Host: deployment-mediawiki05
Address: 10.68.22.21
State: WARNING
Date/Time: Thu 01 Mar 23:58:46 UTC 2018
Notes URLs:
Additional Info:
WARNING: deployment-prep.deployment-mediawiki05.diskspace.root.byte_percentfree
(<11.11%)
Notification Type: PROBLEM
Service: App Server Main HTTP Response
Host: deployment-mediawiki06
Address: 10.68.19.241
State: CRITICAL
Date/Time: Fri 02 Mar 00:19:13 UTC 2018
Notes URLs:
Additional Info:
HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - string 'Wikipedia' not
found on
Notification Type: PROBLEM
Service: English Wikipedia Mobile Main page
Host: Generic Beta Cluster
Address: en.wikipedia.beta.wmflabs.org
State: CRITICAL
Date/Time: Fri 02 Mar 00:18:45 UTC 2018
Notes URLs:
Additional Info:
HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - string 'Wikipedia'
Notification Type: PROBLEM
Service: Mediawiki Error Rate
Host: Graphite Labs
Address: graphite-labs.wikimedia.org
State: CRITICAL
Date/Time: Fri 02 Mar 00:57:28 UTC 2018
Notes URLs:
Additional Info:
CRITICAL: 20.00% of data above the critical threshold [10.0]
Notification Type: PROBLEM
Service: Mediawiki Error Rate
Host: Graphite Labs
Address: graphite-labs.wikimedia.org
State: WARNING
Date/Time: Fri 02 Mar 00:52:30 UTC 2018
Notes URLs:
Additional Info:
WARNING: 80.00% of data above the warning threshold [1.0]
Notification Type: PROBLEM
Service: Mediawiki Error Rate
Host: Graphite Labs
Address: graphite-labs.wikimedia.org
State: WARNING
Date/Time: Fri 02 Mar 03:57:30 UTC 2018
Notes URLs:
Additional Info:
WARNING: 80.00% of data above the warning threshold [1.0]
Notification Type: PROBLEM
Service: English Wikipedia Main page
Host: Generic Beta Cluster
Address: en.wikipedia.beta.wmflabs.org
State: CRITICAL
Date/Time: Fri 02 Mar 00:20:07 UTC 2018
Notes URLs:
Additional Info:
HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'Wikipedia' not
Notification Type: PROBLEM
Service: Mediawiki Error Rate
Host: Graphite Labs
Address: graphite-labs.wikimedia.org
State: CRITICAL
Date/Time: Fri 02 Mar 00:32:29 UTC 2018
Notes URLs:
Additional Info:
CRITICAL: 60.00% of data above the critical threshold [10.0]
Notification Type: PROBLEM
Service: Mediawiki Error Rate
Host: Graphite Labs
Address: graphite-labs.wikimedia.org
State: CRITICAL
Date/Time: Fri 02 Mar 04:12:31 UTC 2018
Notes URLs:
Additional Info:
CRITICAL: 20.00% of data above the critical threshold [10.0]
Notification Type: RECOVERY
Service: Free space - all mounts
Host: deployment-mediawiki05
Address: 10.68.22.21
State: OK
Date/Time: Fri 02 Mar 00:08:48 UTC 2018
Notes URLs:
Additional Info:
OK: All targets OK
___
Betacluster-alerts mailing list
Notification Type: PROBLEM
Service: Mediawiki Error Rate
Host: Graphite Labs
Address: graphite-labs.wikimedia.org
State: CRITICAL
Date/Time: Fri 02 Mar 00:22:29 UTC 2018
Notes URLs:
Additional Info:
CRITICAL: 20.00% of data above the critical threshold [10.0]
Notification Type: PROBLEM
Service: App Server Main HTTP Response
Host: deployment-mediawiki05
Address: 10.68.22.21
State: CRITICAL
Date/Time: Fri 02 Mar 00:23:06 UTC 2018
Notes URLs:
Additional Info:
HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - string 'Wikipedia' not
found on
Notification Type: PROBLEM
Service: App Server Main HTTP Response
Host: deployment-mediawiki04
Address: 10.68.19.128
State: CRITICAL
Date/Time: Fri 02 Mar 00:23:21 UTC 2018
Notes URLs:
Additional Info:
HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - string 'Wikipedia' not
found on
Notification Type: PROBLEM
Service: Mediawiki Error Rate
Host: Graphite Labs
Address: graphite-labs.wikimedia.org
State: WARNING
Date/Time: Fri 02 Mar 04:32:28 UTC 2018
Notes URLs:
Additional Info:
WARNING: 80.00% of data above the warning threshold [1.0]
Notification Type: PROBLEM
Service: Mediawiki Error Rate
Host: Graphite Labs
Address: graphite-labs.wikimedia.org
State: WARNING
Date/Time: Fri 02 Mar 00:27:28 UTC 2018
Notes URLs:
Additional Info:
WARNING: 80.00% of data above the warning threshold [1.0]
Notification Type: PROBLEM
Service: Mediawiki Error Rate
Host: Graphite Labs
Address: graphite-labs.wikimedia.org
State: WARNING
Date/Time: Fri 02 Mar 05:42:29 UTC 2018
Notes URLs:
Additional Info:
WARNING: 80.00% of data above the warning threshold [1.0]
Notification Type: PROBLEM
Service: Free space - all mounts
Host: deployment-mediawiki05
Address: 10.68.22.21
State: WARNING
Date/Time: Fri 02 Mar 06:39:47 UTC 2018
Notes URLs:
Additional Info:
WARNING: deployment-prep.deployment-mediawiki05.diskspace.root.byte_percentfree
(<11.11%)
Notification Type: PROBLEM
Service: Free space - all mounts
Host: deployment-tin
Address: 10.68.21.205
State: CRITICAL
Date/Time: Fri 02 Mar 06:42:40 UTC 2018
Notes URLs:
Additional Info:
CRITICAL: deployment-prep.deployment-tin.diskspace._mnt.byte_percentfree (No
valid datapoints
Notification Type: RECOVERY
Service: Free space - all mounts
Host: deployment-mediawiki05
Address: 10.68.22.21
State: OK
Date/Time: Fri 02 Mar 06:49:48 UTC 2018
Notes URLs:
Additional Info:
OK: All targets OK
___
Betacluster-alerts mailing list
Notification Type: PROBLEM
Service: Mediawiki Error Rate
Host: Graphite Labs
Address: graphite-labs.wikimedia.org
State: CRITICAL
Date/Time: Fri 02 Mar 04:42:29 UTC 2018
Notes URLs:
Additional Info:
CRITICAL: 60.00% of data above the critical threshold [10.0]
Notification Type: PROBLEM
Service: Mediawiki Error Rate
Host: Graphite Labs
Address: graphite-labs.wikimedia.org
State: CRITICAL
Date/Time: Fri 02 Mar 05:47:29 UTC 2018
Notes URLs:
Additional Info:
CRITICAL: 20.00% of data above the critical threshold [10.0]
Notification Type: PROBLEM
Service: Mediawiki Error Rate
Host: Graphite Labs
Address: graphite-labs.wikimedia.org
State: WARNING
Date/Time: Fri 02 Mar 05:52:28 UTC 2018
Notes URLs:
Additional Info:
WARNING: 80.00% of data above the warning threshold [1.0]
Notification Type: PROBLEM
Service: Free space - all mounts
Host: deployment-fluorine02
Address: 10.68.23.106
State: WARNING
Date/Time: Fri 02 Mar 05:50:38 UTC 2018
Notes URLs:
Additional Info:
WARNING: deployment-prep.deployment-fluorine02.diskspace._srv.byte_percentfree
(<44.44%)
Notification Type: PROBLEM
Service: Free space - all mounts
Host: deployment-tin
Address: 10.68.21.205
State: WARNING
Date/Time: Fri 02 Mar 06:52:38 UTC 2018
Notes URLs:
Additional Info:
WARNING: deployment-prep.deployment-tin.diskspace._mnt.byte_percentfree (No
valid datapoints
Notification Type: RECOVERY
Service: Free space - all mounts
Host: deployment-fluorine02
Address: 10.68.23.106
State: OK
Date/Time: Fri 02 Mar 07:00:39 UTC 2018
Notes URLs:
Additional Info:
OK: All targets OK
___
Betacluster-alerts mailing list
Notification Type: RECOVERY
Service: Mediawiki Error Rate
Host: Graphite Labs
Address: graphite-labs.wikimedia.org
State: OK
Date/Time: Thu 01 Mar 18:28:31 UTC 2018
Notes URLs:
Additional Info:
OK: Less than 1.00% above the threshold [1.0]
___
53 matches
Mail list logo