Notification Type: PROBLEM
Host: deployment-sentry01
State: DOWN
Address: 10.68.19.148
Info: CRITICAL - Host Unreachable (10.68.19.148)
Date/Time: Tue 16 Jan 18:15:25 UTC 2018
___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
Notification Type: PROBLEM
Host: deployment-ms-be04
State: DOWN
Address: 10.68.16.139
Info: CRITICAL - Host Unreachable (10.68.16.139)
Date/Time: Tue 16 Jan 18:15:14 UTC 2018
___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
Notification Type: PROBLEM
Host: deployment-restbase02
State: DOWN
Address: 10.68.17.189
Info: CRITICAL - Host Unreachable (10.68.17.189)
Date/Time: Tue 16 Jan 18:14:05 UTC 2018
___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
Notification Type: PROBLEM
Host: deployment-cache-text04
State: DOWN
Address: 10.68.18.103
Info: CRITICAL - Host Unreachable (10.68.18.103)
Date/Time: Tue 16 Jan 18:13:20 UTC 2018
___
Betacluster-alerts mailing list
Notification Type: PROBLEM
Host: beta-cluster
State: DOWN
Address: en.wikipedia.beta.wmflabs.org
Info: CRITICAL - Host Unreachable (en.wikipedia.beta.wmflabs.org)
Date/Time: Tue 16 Jan 18:12:50 UTC 2018
___
Betacluster-alerts mailing list
Notification Type: PROBLEM
Service: English Wikipedia Main page
Host: Generic Beta Cluster
Address: en.wikipedia.beta.wmflabs.org
State: CRITICAL
Date/Time: Tue 16 Jan 18:11:49 UTC 2018
Notes URLs:
Additional Info:
CRITICAL - Socket timeout after 10 seconds
Notification Type: RECOVERY
Host: deployment-memc04
State: UP
Address: 10.68.23.25
Info: PING OK - Packet loss = 0%, RTA = 8.18 ms
Date/Time: Tue 16 Jan 18:02:29 UTC 2018
___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
Notification Type: RECOVERY
Host: deployment-zookeeper02
State: UP
Address: 10.68.18.75
Info: PING OK - Packet loss = 0%, RTA = 4.00 ms
Date/Time: Tue 16 Jan 18:01:07 UTC 2018
___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
Notification Type: RECOVERY
Host: deployment-aqs01
State: UP
Address: 10.68.18.237
Info: PING OK - Packet loss = 0%, RTA = 4.15 ms
Date/Time: Tue 16 Jan 18:00:56 UTC 2018
___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
Notification Type: RECOVERY
Service: English Wikipedia Main page
Host: Generic Beta Cluster
Address: en.wikipedia.beta.wmflabs.org
State: OK
Date/Time: Tue 16 Jan 18:00:39 UTC 2018
Notes URLs:
Additional Info:
HTTP OK: HTTP/1.1 200 OK - 47434 bytes in 0.724 second response time
Notification Type: RECOVERY
Host: deployment-restbase01
State: UP
Address: 10.68.16.128
Info: PING OK - Packet loss = 0%, RTA = 44.08 ms
Date/Time: Tue 16 Jan 18:00:32 UTC 2018
___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
Notification Type: RECOVERY
Service: App Server Main HTTP Response
Host: deployment-mediawiki04
Address: 10.68.19.128
State: OK
Date/Time: Tue 16 Jan 18:00:17 UTC 2018
Notes URLs:
Additional Info:
HTTP OK: HTTP/1.1 200 OK - 46849 bytes in 1.600 second response time
Notification Type: RECOVERY
Service: App Server Main HTTP Response
Host: deployment-mediawiki05
Address: 10.68.22.21
State: OK
Date/Time: Tue 16 Jan 17:58:35 UTC 2018
Notes URLs:
Additional Info:
HTTP OK: HTTP/1.1 200 OK - 46843 bytes in 1.152 second response time
Notification Type: RECOVERY
Service: App Server Main HTTP Response
Host: deployment-mediawiki06
Address: 10.68.19.241
State: OK
Date/Time: Tue 16 Jan 17:57:57 UTC 2018
Notes URLs:
Additional Info:
HTTP OK: HTTP/1.1 200 OK - 46799 bytes in 4.571 second response time
Notification Type: RECOVERY
Service: English Wikipedia Mobile Main page
Host: Generic Beta Cluster
Address: en.wikipedia.beta.wmflabs.org
State: OK
Date/Time: Tue 16 Jan 17:56:44 UTC 2018
Notes URLs:
Additional Info:
HTTP OK: HTTP/1.1 200 OK - 35931 bytes in 1.140 second response time
Notification Type: PROBLEM
Service: Mediawiki Error Rate
Host: Graphite Labs
Address: graphite-labs.wikimedia.org
State: WARNING
Date/Time: Tue 16 Jan 17:55:42 UTC 2018
Notes URLs:
Additional Info:
WARNING: 80.00% of data above the warning threshold [1.0]
Notification Type: PROBLEM
Host: deployment-zookeeper02
State: DOWN
Address: 10.68.18.75
Info: CRITICAL - Host Unreachable (10.68.18.75)
Date/Time: Tue 16 Jan 17:54:50 UTC 2018
___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
Notification Type: PROBLEM
Host: deployment-memc04
State: DOWN
Address: 10.68.23.25
Info: CRITICAL - Host Unreachable (10.68.23.25)
Date/Time: Tue 16 Jan 17:53:52 UTC 2018
___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
Notification Type: PROBLEM
Service: Mediawiki Error Rate
Host: Graphite Labs
Address: graphite-labs.wikimedia.org
State: CRITICAL
Date/Time: Tue 16 Jan 17:50:40 UTC 2018
Notes URLs:
Additional Info:
CRITICAL: 20.00% of data above the critical threshold [10.0]
Notification Type: PROBLEM
Host: deployment-restbase01
State: DOWN
Address: 10.68.16.128
Info: CRITICAL - Host Unreachable (10.68.16.128)
Date/Time: Tue 16 Jan 17:50:33 UTC 2018
___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
beta-scap-eqiad - Build # 191109 - Fixed:
Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/191109/ to view the results.___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
Notification Type: RECOVERY
Host: deployment-tmh01
State: UP
Address: 10.68.16.211
Info: PING OK - Packet loss = 0%, RTA = 4.75 ms
Date/Time: Tue 16 Jan 17:44:42 UTC 2018
___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
Notification Type: RECOVERY
Host: deployment-kafka04
State: UP
Address: 10.68.17.9
Info: PING OK - Packet loss = 0%, RTA = 3.37 ms
Date/Time: Tue 16 Jan 17:43:49 UTC 2018
___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
Notification Type: RECOVERY
Host: deployment-redis02
State: UP
Address: 10.68.16.231
Info: PING OK - Packet loss = 0%, RTA = 1.19 ms
Date/Time: Tue 16 Jan 17:43:17 UTC 2018
___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
Notification Type: RECOVERY
Host: deployment-redis06
State: UP
Address: 10.68.20.16
Info: PING OK - Packet loss = 0%, RTA = 2.01 ms
Date/Time: Tue 16 Jan 17:41:45 UTC 2018
___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
beta-scap-eqiad - Build # 191108 - Failure:
Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/191108/ to view the results.___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
Notification Type: PROBLEM
Host: deployment-kafka04
State: DOWN
Address: 10.68.17.9
Info: CRITICAL - Host Unreachable (10.68.17.9)
Date/Time: Tue 16 Jan 17:36:47 UTC 2018
___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
Notification Type: PROBLEM
Host: deployment-tmh01
State: DOWN
Address: 10.68.16.211
Info: CRITICAL - Host Unreachable (10.68.16.211)
Date/Time: Tue 16 Jan 17:34:41 UTC 2018
___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
Notification Type: PROBLEM
Host: deployment-redis02
State: DOWN
Address: 10.68.16.231
Info: CRITICAL - Host Unreachable (10.68.16.231)
Date/Time: Tue 16 Jan 17:34:04 UTC 2018
___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
Notification Type: PROBLEM
Host: deployment-zotero01
State: DOWN
Address: 10.68.17.102
Info: CRITICAL - Host Unreachable (10.68.17.102)
Date/Time: Tue 16 Jan 17:34:09 UTC 2018
___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
Notification Type: PROBLEM
Host: deployment-redis06
State: DOWN
Address: 10.68.20.16
Info: CRITICAL - Host Unreachable (10.68.20.16)
Date/Time: Tue 16 Jan 17:33:30 UTC 2018
___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
Notification Type: PROBLEM
Service: English Wikipedia Mobile Main page
Host: Generic Beta Cluster
Address: en.wikipedia.beta.wmflabs.org
State: CRITICAL
Date/Time: Tue 16 Jan 17:31:42 UTC 2018
Notes URLs:
Additional Info:
HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - string 'Wikipedia'
Notification Type: PROBLEM
Service: English Wikipedia Main page
Host: Generic Beta Cluster
Address: en.wikipedia.beta.wmflabs.org
State: CRITICAL
Date/Time: Tue 16 Jan 17:30:40 UTC 2018
Notes URLs:
Additional Info:
HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - string 'Wikipedia' not
Notification Type: PROBLEM
Service: Mediawiki Error Rate
Host: Graphite Labs
Address: graphite-labs.wikimedia.org
State: WARNING
Date/Time: Tue 16 Jan 17:30:43 UTC 2018
Notes URLs:
Additional Info:
WARNING: 80.00% of data above the warning threshold [1.0]
Notification Type: PROBLEM
Service: App Server Main HTTP Response
Host: deployment-mediawiki04
Address: 10.68.19.128
State: CRITICAL
Date/Time: Tue 16 Jan 17:30:17 UTC 2018
Notes URLs:
Additional Info:
HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - string 'Wikipedia' not
found on
Notification Type: PROBLEM
Service: App Server Main HTTP Response
Host: deployment-mediawiki05
Address: 10.68.22.21
State: CRITICAL
Date/Time: Tue 16 Jan 17:28:36 UTC 2018
Notes URLs:
Additional Info:
HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - string 'Wikipedia' not
found on
Notification Type: PROBLEM
Service: Puppet errors
Host: deployment-snapshot01
Address: 10.68.19.94
State: CRITICAL
Date/Time: Tue 16 Jan 17:28:46 UTC 2018
Notes URLs:
Additional Info:
CRITICAL: 100.00% of data above the critical threshold [0.0]
___
Notification Type: PROBLEM
Service: Puppet errors
Host: deployment-elastic06
Address: 10.68.23.242
State: CRITICAL
Date/Time: Tue 16 Jan 17:27:14 UTC 2018
Notes URLs:
Additional Info:
CRITICAL: 16.67% of data above the critical threshold [0.0]
___
Notification Type: RECOVERY
Host: deployment-ms-fe02
State: UP
Address: 10.68.19.247
Info: PING OK - Packet loss = 0%, RTA = 2.01 ms
Date/Time: Tue 16 Jan 17:24:56 UTC 2018
___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
Notification Type: RECOVERY
Host: deployment-elastic06
State: UP
Address: 10.68.23.242
Info: PING OK - Packet loss = 0%, RTA = 1.97 ms
Date/Time: Tue 16 Jan 17:21:22 UTC 2018
___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
Notification Type: PROBLEM
Host: deployment-elastic06
State: DOWN
Address: 10.68.23.242
Info: CRITICAL - Host Unreachable (10.68.23.242)
Date/Time: Tue 16 Jan 17:15:27 UTC 2018
___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
Notification Type: PROBLEM
Host: deployment-ms-fe02
State: DOWN
Address: 10.68.19.247
Info: CRITICAL - Host Unreachable (10.68.19.247)
Date/Time: Tue 16 Jan 17:14:20 UTC 2018
___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
Notification Type: PROBLEM
Service: Free space - all mounts
Host: deployment-tin
Address: 10.68.21.205
State: WARNING
Date/Time: Tue 16 Jan 17:02:52 UTC 2018
Notes URLs:
Additional Info:
WARNING: deployment-prep.deployment-tin.diskspace._mnt.byte_percentfree (No
valid datapoints
Notification Type: RECOVERY
Service: Free space - all mounts
Host: deployment-tin
Address: 10.68.21.205
State: OK
Date/Time: Tue 16 Jan 16:41:52 UTC 2018
Notes URLs:
Additional Info:
OK: deployment-prep.deployment-tin.diskspace._mnt.byte_percentfree (No valid
datapoints found)
Notification Type: PROBLEM
Service: Free space - all mounts
Host: deployment-tin
Address: 10.68.21.205
State: WARNING
Date/Time: Tue 16 Jan 16:31:53 UTC 2018
Notes URLs:
Additional Info:
WARNING: deployment-prep.deployment-tin.diskspace._mnt.byte_percentfree (No
valid datapoints
Notification Type: RECOVERY
Service: Puppet errors
Host: deployment-etcd-01
Address: 10.68.19.227
State: OK
Date/Time: Tue 16 Jan 16:27:20 UTC 2018
Notes URLs:
Additional Info:
OK: Less than 1.00% above the threshold [0.0]
___
Betacluster-alerts
Notification Type: PROBLEM
Service: Puppet errors
Host: deployment-etcd-01
Address: 10.68.19.227
State: CRITICAL
Date/Time: Tue 16 Jan 16:22:21 UTC 2018
Notes URLs:
Additional Info:
CRITICAL: 12.50% of data above the critical threshold [0.0]
___
beta-scap-eqiad - Build # 191095 - Fixed:
Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/191095/ to view the results.___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
Notification Type: RECOVERY
Host: deployment-ms-be03
State: UP
Address: 10.68.22.125
Info: PING OK - Packet loss = 0%, RTA = 200.61 ms
Date/Time: Tue 16 Jan 16:14:19 UTC 2018
___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
beta-scap-eqiad - Build # 191094 - Still Failing:
Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/191094/ to view the results.___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
Notification Type: PROBLEM
Host: deployment-etcd-01
State: DOWN
Address: 10.68.19.227
Info: CRITICAL - Host Unreachable (10.68.19.227)
Date/Time: Tue 16 Jan 15:59:56 UTC 2018
___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
beta-scap-eqiad - Build # 191093 - Failure:
Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/191093/ to view the results.___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
Notification Type: RECOVERY
Service: Mediawiki Error Rate
Host: Graphite Labs
Address: graphite-labs.wikimedia.org
State: OK
Date/Time: Tue 16 Jan 15:36:40 UTC 2018
Notes URLs:
Additional Info:
OK: Less than 1.00% above the threshold [1.0]
___
Notification Type: PROBLEM
Service: Mediawiki Error Rate
Host: Graphite Labs
Address: graphite-labs.wikimedia.org
State: WARNING
Date/Time: Tue 16 Jan 15:26:43 UTC 2018
Notes URLs:
Additional Info:
WARNING: 40.00% of data above the warning threshold [1.0]
Notification Type: RECOVERY
Service: Free space - all mounts
Host: deployment-tin
Address: 10.68.21.205
State: OK
Date/Time: Tue 16 Jan 15:20:55 UTC 2018
Notes URLs:
Additional Info:
OK: deployment-prep.deployment-tin.diskspace._mnt.byte_percentfree (No valid
datapoints found)
Notification Type: PROBLEM
Service: Free space - all mounts
Host: deployment-tin
Address: 10.68.21.205
State: WARNING
Date/Time: Tue 16 Jan 15:15:53 UTC 2018
Notes URLs:
Additional Info:
WARNING: deployment-prep.deployment-tin.diskspace._mnt.byte_percentfree (No
valid datapoints
Notification Type: RECOVERY
Service: Free space - all mounts
Host: deployment-tin
Address: 10.68.21.205
State: OK
Date/Time: Tue 16 Jan 15:09:53 UTC 2018
Notes URLs:
Additional Info:
OK: deployment-prep.deployment-tin.diskspace._mnt.byte_percentfree (No valid
datapoints found)
Notification Type: PROBLEM
Service: Free space - all mounts
Host: deployment-tin
Address: 10.68.21.205
State: WARNING
Date/Time: Tue 16 Jan 15:04:54 UTC 2018
Notes URLs:
Additional Info:
WARNING: deployment-prep.deployment-tin.diskspace._mnt.byte_percentfree (No
valid datapoints
Notification Type: PROBLEM
Host: deployment-puppetdb01
State: DOWN
Address: 10.68.23.76
Info: CRITICAL - Host Unreachable (10.68.23.76)
Date/Time: Tue 16 Jan 14:53:14 UTC 2018
___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
Notification Type: PROBLEM
Service: Mediawiki Error Rate
Host: Graphite Labs
Address: graphite-labs.wikimedia.org
State: WARNING
Date/Time: Tue 16 Jan 14:15:40 UTC 2018
Notes URLs:
Additional Info:
WARNING: 40.00% of data above the warning threshold [1.0]
Notification Type: RECOVERY
Service: Mediawiki Error Rate
Host: Graphite Labs
Address: graphite-labs.wikimedia.org
State: OK
Date/Time: Tue 16 Jan 13:38:43 UTC 2018
Notes URLs:
Additional Info:
OK: Less than 1.00% above the threshold [1.0]
___
Notification Type: PROBLEM
Service: Mediawiki Error Rate
Host: Graphite Labs
Address: graphite-labs.wikimedia.org
State: WARNING
Date/Time: Tue 16 Jan 13:33:41 UTC 2018
Notes URLs:
Additional Info:
WARNING: 40.00% of data above the warning threshold [1.0]
Notification Type: RECOVERY
Service: Free space - all mounts
Host: deployment-tin
Address: 10.68.21.205
State: OK
Date/Time: Tue 16 Jan 11:33:53 UTC 2018
Notes URLs:
Additional Info:
OK: deployment-prep.deployment-tin.diskspace._mnt.byte_percentfree (No valid
datapoints found)
Notification Type: PROBLEM
Service: Free space - all mounts
Host: deployment-tin
Address: 10.68.21.205
State: WARNING
Date/Time: Tue 16 Jan 11:18:53 UTC 2018
Notes URLs:
Additional Info:
WARNING: deployment-prep.deployment-tin.diskspace._mnt.byte_percentfree (No
valid datapoints
Notification Type: PROBLEM
Service: Free space - all mounts
Host: deployment-kafka01
Address: 10.68.21.219
State: CRITICAL
Date/Time: Tue 16 Jan 09:59:30 UTC 2018
Notes URLs:
Additional Info:
CRITICAL: deployment-prep.deployment-kafka01.diskspace.root.byte_percentfree
(<22.22%)
Notification Type: RECOVERY
Service: Mediawiki Error Rate
Host: Graphite Labs
Address: graphite-labs.wikimedia.org
State: OK
Date/Time: Tue 16 Jan 09:07:41 UTC 2018
Notes URLs:
Additional Info:
OK: Less than 1.00% above the threshold [1.0]
___
Notification Type: PROBLEM
Service: Mediawiki Error Rate
Host: Graphite Labs
Address: graphite-labs.wikimedia.org
State: WARNING
Date/Time: Tue 16 Jan 09:02:44 UTC 2018
Notes URLs:
Additional Info:
WARNING: 20.00% of data above the warning threshold [1.0]
Notification Type: PROBLEM
Service: Free space - all mounts
Host: deployment-tin
Address: 10.68.21.205
State: WARNING
Date/Time: Tue 16 Jan 08:07:53 UTC 2018
Notes URLs:
Additional Info:
WARNING: deployment-prep.deployment-tin.diskspace._mnt.byte_percentfree (No
valid datapoints
201 - 268 of 268 matches
Mail list logo
