Notification Type: PROBLEM
Service: Free space - all mounts
Host: deployment-mediawiki-07
Address: 10.68.18.62
State: WARNING
Date/Time: Fri 13 Apr 04:25:13 UTC 2018
Notes URLs:
Additional Info:
WARNING:
deployment-prep.deployment-mediawiki-07.diskspace.root.byte_percentfree
(<22.22%)
Notification Type: RECOVERY
Service: Free space - all mounts
Host: deployment-ores01
Address: 10.68.20.26
State: OK
Date/Time: Fri 13 Apr 01:09:56 UTC 2018
Notes URLs:
Additional Info:
OK: deployment-prep.deployment-ores01.diskspace._srv.byte_percentfree (No valid
datapoints found)
Notification Type: PROBLEM
Service: Free space - all mounts
Host: deployment-ores01
Address: 10.68.20.26
State: CRITICAL
Date/Time: Fri 13 Apr 00:59:58 UTC 2018
Notes URLs:
Additional Info:
CRITICAL: deployment-prep.deployment-ores01.diskspace._srv.byte_percentfree (No
valid datapoints
Notification Type: PROBLEM
Service: Free space - all mounts
Host: deployment-fluorine02
Address: 10.68.23.106
State: CRITICAL
Date/Time: Fri 13 Apr 00:39:31 UTC 2018
Notes URLs:
Additional Info:
CRITICAL: deployment-prep.deployment-fluorine02.diskspace._srv.byte_percentfree
(<30.00%)
Notification Type: RECOVERY
Service: Puppet errors
Host: deployment-aqs01
Address: 10.68.18.237
State: OK
Date/Time: Thu 12 Apr 23:18:45 UTC 2018
Notes URLs:
Additional Info:
OK: Less than 1.00% above the threshold [0.0]
___
Betacluster-alerts
Notification Type: PROBLEM
Service: Puppet errors
Host: deployment-aqs01
Address: 10.68.18.237
State: CRITICAL
Date/Time: Thu 12 Apr 22:38:45 UTC 2018
Notes URLs:
Additional Info:
CRITICAL: 30.00% of data above the critical threshold [0.0]
___
Notification Type: RECOVERY
Service: App Server Main HTTP Response
Host: deployment-mediawiki-07
Address: 10.68.18.62
State: OK
Date/Time: Thu 12 Apr 22:36:57 UTC 2018
Notes URLs:
Additional Info:
HTTP OK: HTTP/1.1 200 OK - 46945 bytes in 4.819 second response time
Notification Type: PROBLEM
Service: Free space - all mounts
Host: deployment-fluorine02
Address: 10.68.23.106
State: WARNING
Date/Time: Thu 12 Apr 21:44:31 UTC 2018
Notes URLs:
Additional Info:
WARNING: deployment-prep.deployment-fluorine02.diskspace._srv.byte_percentfree
(<40.00%)
Notification Type: PROBLEM
Service: Puppet errors
Host: deployment-mx02
Address: 10.68.23.220
State: CRITICAL
Date/Time: Thu 12 Apr 21:08:21 UTC 2018
Notes URLs:
Additional Info:
CRITICAL: 100.00% of data above the critical threshold [0.0]
___
Notification Type: PROBLEM
Service: Mediawiki Error Rate
Host: Graphite Labs
Address: graphite-labs.wikimedia.org
State: WARNING
Date/Time: Thu 12 Apr 20:44:27 UTC 2018
Notes URLs:
Additional Info:
WARNING: 80.00% of data above the warning threshold [1.0]
Notification Type: PROBLEM
Service: Mediawiki Error Rate
Host: Graphite Labs
Address: graphite-labs.wikimedia.org
State: CRITICAL
Date/Time: Thu 12 Apr 20:24:27 UTC 2018
Notes URLs:
Additional Info:
CRITICAL: 80.00% of data above the critical threshold [10.0]
Notification Type: PROBLEM
Service: Mediawiki Error Rate
Host: Graphite Labs
Address: graphite-labs.wikimedia.org
State: WARNING
Date/Time: Thu 12 Apr 20:19:27 UTC 2018
Notes URLs:
Additional Info:
WARNING: 80.00% of data above the warning threshold [1.0]
Notification Type: RECOVERY
Service: Free space - all mounts
Host: deployment-mediawiki04
Address: 10.68.19.128
State: OK
Date/Time: Thu 12 Apr 19:52:14 UTC 2018
Notes URLs:
Additional Info:
OK: All targets OK
___
Betacluster-alerts mailing list
Notification Type: PROBLEM
Service: Mediawiki Error Rate
Host: Graphite Labs
Address: graphite-labs.wikimedia.org
State: CRITICAL
Date/Time: Thu 12 Apr 19:49:26 UTC 2018
Notes URLs:
Additional Info:
CRITICAL: 20.00% of data above the critical threshold [10.0]
Notification Type: PROBLEM
Service: Free space - all mounts
Host: deployment-mediawiki04
Address: 10.68.19.128
State: WARNING
Date/Time: Thu 12 Apr 19:42:12 UTC 2018
Notes URLs:
Additional Info:
WARNING: deployment-prep.deployment-mediawiki04.diskspace.root.byte_percentfree
(<11.11%)
Notification Type: RECOVERY
Service: Puppet errors
Host: deployment-mediawiki04
Address: 10.68.19.128
State: OK
Date/Time: Thu 12 Apr 19:35:23 UTC 2018
Notes URLs:
Additional Info:
OK: Less than 1.00% above the threshold [0.0]
___
Notification Type: PROBLEM
Service: Puppet errors
Host: deployment-mediawiki04
Address: 10.68.19.128
State: CRITICAL
Date/Time: Thu 12 Apr 19:05:22 UTC 2018
Notes URLs:
Additional Info:
CRITICAL: 44.44% of data above the critical threshold [0.0]
Notification Type: RECOVERY
Service: Puppet errors
Host: deployment-cache-text04
Address: 10.68.18.103
State: OK
Date/Time: Thu 12 Apr 19:02:28 UTC 2018
Notes URLs:
Additional Info:
OK: Less than 1.00% above the threshold [0.0]
___
Notification Type: RECOVERY
Service: English Wikipedia Mobile Main page
Host: Generic Beta Cluster
Address: en.wikipedia.beta.wmflabs.org
State: OK
Date/Time: Thu 12 Apr 18:59:44 UTC 2018
Notes URLs:
Additional Info:
HTTP OK: HTTP/1.1 200 OK - 36444 bytes in 3.664 second response time
Notification Type: RECOVERY
Service: English Wikipedia Main page
Host: Generic Beta Cluster
Address: en.wikipedia.beta.wmflabs.org
State: OK
Date/Time: Thu 12 Apr 18:54:58 UTC 2018
Notes URLs:
Additional Info:
HTTP OK: HTTP/1.1 200 OK - 48074 bytes in 4.203 second response time
Notification Type: PROBLEM
Service: Puppet errors
Host: deployment-secureredirexperiment
Address: 10.68.17.132
State: CRITICAL
Date/Time: Thu 12 Apr 18:54:27 UTC 2018
Notes URLs:
Additional Info:
CRITICAL: 100.00% of data above the critical threshold [0.0]
Notification Type: PROBLEM
Service: Puppet errors
Host: deployment-cache-text04
Address: 10.68.18.103
State: CRITICAL
Date/Time: Thu 12 Apr 18:52:28 UTC 2018
Notes URLs:
Additional Info:
CRITICAL: 40.00% of data above the critical threshold [0.0]
Notification Type: RECOVERY
Service: Free space - all mounts
Host: deployment-tin
Address: 10.68.21.205
State: OK
Date/Time: Thu 12 Apr 18:21:34 UTC 2018
Notes URLs:
Additional Info:
OK: deployment-prep.deployment-tin.diskspace._mnt.byte_percentfree (No valid
datapoints found)
Notification Type: RECOVERY
Service: Free space - all mounts
Host: deployment-mediawiki-07
Address: 10.68.18.62
State: OK
Date/Time: Thu 12 Apr 17:34:12 UTC 2018
Notes URLs:
Additional Info:
OK: All targets OK
___
Betacluster-alerts mailing list
beta-scap-eqiad - Build # 203553 - Fixed:
Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/203553/ to view the results.___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
Notification Type: PROBLEM
Service: Free space - all mounts
Host: deployment-mediawiki-07
Address: 10.68.18.62
State: CRITICAL
Date/Time: Thu 12 Apr 17:29:11 UTC 2018
Notes URLs:
Additional Info:
CRITICAL:
deployment-prep.deployment-mediawiki-07.diskspace.root.byte_percentfree
(<11.11%)
beta-scap-eqiad - Build # 203552 - Still Failing:
Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/203552/ to view the results.___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
beta-scap-eqiad - Build # 203551 - Still Failing:
Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/203551/ to view the results.___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
beta-scap-eqiad - Build # 203550 - Still Failing:
Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/203550/ to view the results.___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
Notification Type: RECOVERY
Service: Free space - all mounts
Host: deployment-mediawiki05
Address: 10.68.22.21
State: OK
Date/Time: Thu 12 Apr 17:00:22 UTC 2018
Notes URLs:
Additional Info:
OK: All targets OK
___
Betacluster-alerts mailing list
Notification Type: PROBLEM
Service: Free space - all mounts
Host: deployment-tin
Address: 10.68.21.205
State: WARNING
Date/Time: Thu 12 Apr 16:56:35 UTC 2018
Notes URLs:
Additional Info:
WARNING: deployment-prep.deployment-tin.diskspace._mnt.byte_percentfree (No
valid datapoints
Notification Type: PROBLEM
Service: Free space - all mounts
Host: deployment-mediawiki05
Address: 10.68.22.21
State: WARNING
Date/Time: Thu 12 Apr 16:55:23 UTC 2018
Notes URLs:
Additional Info:
WARNING: deployment-prep.deployment-mediawiki05.diskspace.root.byte_percentfree
(<11.11%)
beta-scap-eqiad - Build # 203549 - Still Failing:
Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/203549/ to view the results.___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
beta-scap-eqiad - Build # 203548 - Still Failing:
Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/203548/ to view the results.___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
beta-scap-eqiad - Build # 203547 - Still Failing:
Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/203547/ to view the results.___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
beta-scap-eqiad - Build # 203546 - Still Failing:
Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/203546/ to view the results.___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
beta-scap-eqiad - Build # 203545 - Still Failing:
Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/203545/ to view the results.___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
Notification Type: RECOVERY
Service: Free space - all mounts
Host: deployment-tin
Address: 10.68.21.205
State: OK
Date/Time: Thu 12 Apr 15:40:36 UTC 2018
Notes URLs:
Additional Info:
OK: deployment-prep.deployment-tin.diskspace._mnt.byte_percentfree (No valid
datapoints found)
beta-scap-eqiad - Build # 203544 - Still Failing:
Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/203544/ to view the results.___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
Notification Type: PROBLEM
Service: Free space - all mounts
Host: deployment-tin
Address: 10.68.21.205
State: WARNING
Date/Time: Thu 12 Apr 15:35:36 UTC 2018
Notes URLs:
Additional Info:
WARNING: deployment-prep.deployment-tin.diskspace._mnt.byte_percentfree (No
valid datapoints
Notification Type: RECOVERY
Service: Free space - all mounts
Host: deployment-mediawiki05
Address: 10.68.22.21
State: OK
Date/Time: Thu 12 Apr 15:34:25 UTC 2018
Notes URLs:
Additional Info:
OK: All targets OK
___
Betacluster-alerts mailing list
Notification Type: PROBLEM
Service: Free space - all mounts
Host: deployment-mediawiki05
Address: 10.68.22.21
State: WARNING
Date/Time: Thu 12 Apr 15:29:23 UTC 2018
Notes URLs:
Additional Info:
WARNING: deployment-prep.deployment-mediawiki05.diskspace.root.byte_percentfree
(<11.11%)
beta-scap-eqiad - Build # 203543 - Still Failing:
Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/203543/ to view the results.___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
Notification Type: PROBLEM
Service: App Server Main HTTP Response
Host: deployment-mediawiki-08
Address: 10.68.17.203
State: CRITICAL
Date/Time: Thu 12 Apr 14:55:11 UTC 2018
Notes URLs:
Additional Info:
Connection refused
___
Betacluster-alerts
Notification Type: PROBLEM
Host: deployment-puppetdb01
State: DOWN
Address: 10.68.23.76
Info: CRITICAL - Host Unreachable (10.68.23.76)
Date/Time: Thu 12 Apr 14:53:14 UTC 2018
___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
beta-scap-eqiad - Build # 203542 - Failure:
Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/203542/ to view the results.___
Betacluster-alerts mailing list
Betacluster-alerts@lists.wikimedia.org
Notification Type: PROBLEM
Service: Mediawiki Error Rate
Host: Graphite Labs
Address: graphite-labs.wikimedia.org
State: WARNING
Date/Time: Thu 12 Apr 14:44:26 UTC 2018
Notes URLs:
Additional Info:
WARNING: 80.00% of data above the warning threshold [1.0]
Notification Type: RECOVERY
Service: Mediawiki Error Rate
Host: Graphite Labs
Address: graphite-labs.wikimedia.org
State: OK
Date/Time: Thu 12 Apr 14:38:26 UTC 2018
Notes URLs:
Additional Info:
OK: Less than 1.00% above the threshold [1.0]
___
Notification Type: PROBLEM
Service: English Wikipedia Main page
Host: Generic Beta Cluster
Address: en.wikipedia.beta.wmflabs.org
State: CRITICAL
Date/Time: Thu 12 Apr 14:35:01 UTC 2018
Notes URLs:
Additional Info:
HTTP CRITICAL: HTTP/1.1 503 Backend fetch failed - string 'Wikipedia' not
Notification Type: PROBLEM
Service: English Wikipedia Mobile Main page
Host: Generic Beta Cluster
Address: en.wikipedia.beta.wmflabs.org
State: CRITICAL
Date/Time: Thu 12 Apr 14:34:46 UTC 2018
Notes URLs:
Additional Info:
HTTP CRITICAL: HTTP/1.1 503 Backend fetch failed - string 'Wikipedia'
Notification Type: RECOVERY
Service: Free space - all mounts
Host: deployment-mediawiki04
Address: 10.68.19.128
State: OK
Date/Time: Thu 12 Apr 14:01:11 UTC 2018
Notes URLs:
Additional Info:
OK: All targets OK
___
Betacluster-alerts mailing list
Notification Type: PROBLEM
Service: Free space - all mounts
Host: deployment-mediawiki04
Address: 10.68.19.128
State: WARNING
Date/Time: Thu 12 Apr 13:51:12 UTC 2018
Notes URLs:
Additional Info:
WARNING: deployment-prep.deployment-mediawiki04.diskspace.root.byte_percentfree
(<11.11%)
Notification Type: PROBLEM
Service: Mediawiki Error Rate
Host: Graphite Labs
Address: graphite-labs.wikimedia.org
State: WARNING
Date/Time: Thu 12 Apr 13:48:25 UTC 2018
Notes URLs:
Additional Info:
WARNING: 80.00% of data above the warning threshold [1.0]
Notification Type: RECOVERY
Service: Mediawiki Error Rate
Host: Graphite Labs
Address: graphite-labs.wikimedia.org
State: OK
Date/Time: Thu 12 Apr 13:42:25 UTC 2018
Notes URLs:
Additional Info:
OK: Less than 1.00% above the threshold [1.0]
___
Notification Type: PROBLEM
Service: App Server Main HTTP Response
Host: deployment-mediawiki-07
Address: 10.68.18.62
State: CRITICAL
Date/Time: Thu 12 Apr 12:27:01 UTC 2018
Notes URLs:
Additional Info:
CRITICAL - Socket timeout after 10 seconds
___
Notification Type: RECOVERY
Service: Puppet errors
Host: deployment-mediawiki-07
Address: 10.68.18.62
State: OK
Date/Time: Thu 12 Apr 12:07:16 UTC 2018
Notes URLs:
Additional Info:
OK: Less than 1.00% above the threshold [0.0]
___
Notification Type: PROBLEM
Service: Puppet errors
Host: deployment-mediawiki-07
Address: 10.68.18.62
State: CRITICAL
Date/Time: Thu 12 Apr 11:57:18 UTC 2018
Notes URLs:
Additional Info:
CRITICAL: 87.50% of data above the critical threshold [0.0]
Notification Type: RECOVERY
Service: App Server Main HTTP Response
Host: deployment-mediawiki06
Address: 10.68.19.241
State: OK
Date/Time: Thu 12 Apr 09:41:07 UTC 2018
Notes URLs:
Additional Info:
HTTP OK: HTTP/1.1 200 OK - 47503 bytes in 6.503 second response time
Notification Type: RECOVERY
Service: App Server Main HTTP Response
Host: deployment-mediawiki05
Address: 10.68.22.21
State: OK
Date/Time: Thu 12 Apr 09:34:42 UTC 2018
Notes URLs:
Additional Info:
HTTP OK: HTTP/1.1 200 OK - 47453 bytes in 3.721 second response time
Notification Type: PROBLEM
Service: App Server Main HTTP Response
Host: deployment-mediawiki06
Address: 10.68.19.241
State: CRITICAL
Date/Time: Thu 12 Apr 09:36:12 UTC 2018
Notes URLs:
Additional Info:
CRITICAL - Socket timeout after 10 seconds
___
Notification Type: PROBLEM
Service: App Server Main HTTP Response
Host: deployment-mediawiki05
Address: 10.68.22.21
State: CRITICAL
Date/Time: Thu 12 Apr 09:29:49 UTC 2018
Notes URLs:
Additional Info:
CRITICAL - Socket timeout after 10 seconds
___
Notification Type: RECOVERY
Service: English Wikipedia Mobile Main page
Host: Generic Beta Cluster
Address: en.wikipedia.beta.wmflabs.org
State: OK
Date/Time: Thu 12 Apr 09:22:43 UTC 2018
Notes URLs:
Additional Info:
HTTP OK: HTTP/1.1 200 OK - 36481 bytes in 3.807 second response time
Notification Type: RECOVERY
Service: App Server Main HTTP Response
Host: deployment-mediawiki04
Address: 10.68.19.128
State: OK
Date/Time: Thu 12 Apr 09:22:45 UTC 2018
Notes URLs:
Additional Info:
HTTP OK: HTTP/1.1 200 OK - 47453 bytes in 3.797 second response time
Notification Type: PROBLEM
Service: App Server Main HTTP Response
Host: deployment-mediawiki04
Address: 10.68.19.128
State: CRITICAL
Date/Time: Thu 12 Apr 09:17:52 UTC 2018
Notes URLs:
Additional Info:
CRITICAL - Socket timeout after 10 seconds
___
Notification Type: PROBLEM
Service: English Wikipedia Mobile Main page
Host: Generic Beta Cluster
Address: en.wikipedia.beta.wmflabs.org
State: CRITICAL
Date/Time: Thu 12 Apr 09:17:52 UTC 2018
Notes URLs:
Additional Info:
CRITICAL - Socket timeout after 10 seconds
Notification Type: RECOVERY
Service: Free space - all mounts
Host: deployment-fluorine02
Address: 10.68.23.106
State: OK
Date/Time: Thu 12 Apr 06:53:30 UTC 2018
Notes URLs:
Additional Info:
OK: All targets OK
___
Betacluster-alerts mailing list
Notification Type: PROBLEM
Service: Puppet staleness
Host: deployment-maps03
Address: 10.68.18.91
State: CRITICAL
Date/Time: Thu 12 Apr 06:49:17 UTC 2018
Notes URLs:
Additional Info:
CRITICAL: 55.56% of data above the critical threshold [43200.0]
Notification Type: PROBLEM
Service: Mediawiki Error Rate
Host: Graphite Labs
Address: graphite-labs.wikimedia.org
State: CRITICAL
Date/Time: Thu 12 Apr 06:07:26 UTC 2018
Notes URLs:
Additional Info:
CRITICAL: 40.00% of data above the critical threshold [10.0]
68 matches
Mail list logo