Ema has uploaded a new change for review.
https://gerrit.wikimedia.org/r/311142
Change subject: WIP: varnish: restart upload backends once a day
......................................................................
WIP: varnish: restart upload backends once a day
Automate varnish-be restarts in cache_upload in order to avoid prod
issues while we're debugging T145661.
Change-Id: If07089ac19059250ab5c3429d686fed33db17092
---
M modules/varnish/manifests/instance.pp
A modules/varnish/templates/varnish-backend-restart.cron.erb
2 files changed, 15 insertions(+), 0 deletions(-)
git pull ssh://gerrit.wikimedia.org:29418/operations/puppet
refs/changes/42/311142/1
diff --git a/modules/varnish/manifests/instance.pp
b/modules/varnish/manifests/instance.pp
index 279354f..9fce1d4 100644
--- a/modules/varnish/manifests/instance.pp
+++ b/modules/varnish/manifests/instance.pp
@@ -232,4 +232,18 @@
varnish::monitoring::instance { $ports:
instance => $title,
}
+
+ # XXX: temporary, we need this to mitigate T145661
+ if $title == 'upload-backend' {
+ $be_restart_h = fqdn_rand(24)
+ $be_restart_m = fqdn_rand(60)
+
+ file { '/etc/cron.d/varnish-backend-restart':
+ mode => '0444',
+ owner => 'root',
+ group => 'root',
+ content => template('varnish/varnish-backend-restart.cron.erb'),
+ require => File['/usr/local/sbin/varnish-backend-restart'],
+ }
+ }
}
diff --git a/modules/varnish/templates/varnish-backend-restart.cron.erb
b/modules/varnish/templates/varnish-backend-restart.cron.erb
new file mode 100644
index 0000000..95557bd
--- /dev/null
+++ b/modules/varnish/templates/varnish-backend-restart.cron.erb
@@ -0,0 +1 @@
+<%= @be_restart_m %> <%= @be_restart_h %> * * * root
/usr/local/sbin/varnish-backend-restart
--
To view, visit https://gerrit.wikimedia.org/r/311142
To unsubscribe, visit https://gerrit.wikimedia.org/r/settings
Gerrit-MessageType: newchange
Gerrit-Change-Id: If07089ac19059250ab5c3429d686fed33db17092
Gerrit-PatchSet: 1
Gerrit-Project: operations/puppet
Gerrit-Branch: production
Gerrit-Owner: Ema <e...@wikimedia.org>
_______________________________________________
MediaWiki-commits mailing list
MediaWiki-commits@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
