Giuseppe Lavagetto has uploaded a new change for review.
https://gerrit.wikimedia.org/r/233704
Change subject: nutcracker: reduce logs verbosity on all the high-traffic
clusters
......................................................................
nutcracker: reduce logs verbosity on all the high-traffic clusters
Although a verbosity of 5 makes sense in general, we've ended up with
nutcracker not managing to rotate logs correctly and in all the kind
of disk-full states - one file (already unlinked from the filesystem)
grew to 150 GB. This also makes nutcracker unstable, and upstart loses
track of its pid.
Change-Id: Ida3f85c7c86e3d5f3c17ee9c16f0ba5cd069fb64
---
M hieradata/role/common/mediawiki/appserver.yaml
M hieradata/role/common/mediawiki/appserver/api.yaml
M hieradata/role/common/mediawiki/appserver/canary_api.yaml
M hieradata/role/common/mediawiki/canary_appserver.yaml
M hieradata/role/common/mediawiki/imagescaler.yaml
M hieradata/role/common/mediawiki/jobrunner.yaml
M hieradata/role/common/mediawiki/videoscaler.yaml
7 files changed, 7 insertions(+), 3 deletions(-)
git pull ssh://gerrit.wikimedia.org:29418/operations/puppet
refs/changes/04/233704/1
diff --git a/hieradata/role/common/mediawiki/appserver.yaml
b/hieradata/role/common/mediawiki/appserver.yaml
index a67462e..4f0332a 100644
--- a/hieradata/role/common/mediawiki/appserver.yaml
+++ b/hieradata/role/common/mediawiki/appserver.yaml
@@ -13,3 +13,4 @@
mysql:
connect_timeout: 3000
apache::logrotate::rotate: 12
+nutcracker::verbosity: 4
diff --git a/hieradata/role/common/mediawiki/appserver/api.yaml
b/hieradata/role/common/mediawiki/appserver/api.yaml
index b6ab8df..11ec8a2 100644
--- a/hieradata/role/common/mediawiki/appserver/api.yaml
+++ b/hieradata/role/common/mediawiki/appserver/api.yaml
@@ -13,3 +13,4 @@
mysql:
connect_timeout: 3000
apache::logrotate::rotate: 12
+nutcracker::verbosity: 4
diff --git a/hieradata/role/common/mediawiki/appserver/canary_api.yaml
b/hieradata/role/common/mediawiki/appserver/canary_api.yaml
index bbd17e3..65bcf22 100644
--- a/hieradata/role/common/mediawiki/appserver/canary_api.yaml
+++ b/hieradata/role/common/mediawiki/appserver/canary_api.yaml
@@ -13,3 +13,4 @@
mysql:
connect_timeout: 3000
apache::logrotate::rotate: 12
+nutcracker::verbosity: 4
diff --git a/hieradata/role/common/mediawiki/canary_appserver.yaml
b/hieradata/role/common/mediawiki/canary_appserver.yaml
index d59eb33..2a0d2d4 100644
--- a/hieradata/role/common/mediawiki/canary_appserver.yaml
+++ b/hieradata/role/common/mediawiki/canary_appserver.yaml
@@ -13,3 +13,4 @@
mysql:
connect_timeout: 3000
apache::logrotate::rotate: 12
+nutcracker::verbosity: 4
diff --git a/hieradata/role/common/mediawiki/imagescaler.yaml
b/hieradata/role/common/mediawiki/imagescaler.yaml
index 6e429ba..1992b12 100644
--- a/hieradata/role/common/mediawiki/imagescaler.yaml
+++ b/hieradata/role/common/mediawiki/imagescaler.yaml
@@ -3,4 +3,4 @@
- deployment
role::mediawiki::webserver::pool: rendering
mediawiki::web::mpm_config::workers_limit: 30
-
+nutcracker::verbosity: 4
diff --git a/hieradata/role/common/mediawiki/jobrunner.yaml
b/hieradata/role/common/mediawiki/jobrunner.yaml
index 04bdba2..e909db3 100644
--- a/hieradata/role/common/mediawiki/jobrunner.yaml
+++ b/hieradata/role/common/mediawiki/jobrunner.yaml
@@ -6,4 +6,4 @@
mediawiki::jobrunner::runners_restbase: 3
mediawiki::jobrunner::runners_translate: 1
mediawiki::jobrunner::runners_upload: 7
-
+nutcracker::verbosity: 4
diff --git a/hieradata/role/common/mediawiki/videoscaler.yaml
b/hieradata/role/common/mediawiki/videoscaler.yaml
index 9577816..584d4b5 100644
--- a/hieradata/role/common/mediawiki/videoscaler.yaml
+++ b/hieradata/role/common/mediawiki/videoscaler.yaml
@@ -2,4 +2,4 @@
admin::groups:
- deployment
mediawiki::jobrunner::runners_transcode: 5
-
+nutcracker::verbosity: 4
--
To view, visit https://gerrit.wikimedia.org/r/233704
To unsubscribe, visit https://gerrit.wikimedia.org/r/settings
Gerrit-MessageType: newchange
Gerrit-Change-Id: Ida3f85c7c86e3d5f3c17ee9c16f0ba5cd069fb64
Gerrit-PatchSet: 1
Gerrit-Project: operations/puppet
Gerrit-Branch: production
Gerrit-Owner: Giuseppe Lavagetto <[email protected]>
_______________________________________________
MediaWiki-commits mailing list
[email protected]
https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
