Ori.livneh has submitted this change and it was merged.
Change subject: Job runners: Add a dedicated htmlCacheUpdate runner
......................................................................
Job runners: Add a dedicated htmlCacheUpdate runner
The bulk of the jobs in the queue are Wikidata / enwiki / Commons
htmlCacheUpdate jobs, which use $wgJobBackoffThrottling. Adding a dedicated
runner would help ensure that these jobs get processed as soon as the backoff
expires, and would support Aaron's theory that the de facto throttle rate is
far lower than what we set it to.
Bug: T123815
Bug: T124194
Change-Id: I180856917b5c74437e10e4c9b45e4e0a2ea1e381
---
M hieradata/role/common/mediawiki/jobrunner.yaml
M modules/mediawiki/manifests/jobrunner.pp
M modules/mediawiki/templates/jobrunner/jobrunner.conf.erb
3 files changed, 8 insertions(+), 0 deletions(-)
Approvals:
Ori.livneh: Verified; Looks good to me, approved
diff --git a/hieradata/role/common/mediawiki/jobrunner.yaml
b/hieradata/role/common/mediawiki/jobrunner.yaml
index f5c4dea..93bd460 100644
--- a/hieradata/role/common/mediawiki/jobrunner.yaml
+++ b/hieradata/role/common/mediawiki/jobrunner.yaml
@@ -7,6 +7,7 @@
mediawiki::jobrunner::runners_restbase: 3
mediawiki::jobrunner::runners_translate: 1
mediawiki::jobrunner::runners_upload: 7
+mediawiki::jobrunner::runners_html: 1
nutcracker::verbosity: "4"
hhvm::extra::fcgi:
max_execution_time: 1200
diff --git a/modules/mediawiki/manifests/jobrunner.pp
b/modules/mediawiki/manifests/jobrunner.pp
index 13f9329..cd65bda 100644
--- a/modules/mediawiki/manifests/jobrunner.pp
+++ b/modules/mediawiki/manifests/jobrunner.pp
@@ -7,6 +7,7 @@
$queue_servers,
$aggr_servers = $queue_servers,
$runners_basic = 0,
+ $runners_html = 0,
$runners_upload = 0,
$runners_gwt = 0,
$runners_restbase = 0,
diff --git a/modules/mediawiki/templates/jobrunner/jobrunner.conf.erb
b/modules/mediawiki/templates/jobrunner/jobrunner.conf.erb
index 365fd6b..58a0665 100644
--- a/modules/mediawiki/templates/jobrunner/jobrunner.conf.erb
+++ b/modules/mediawiki/templates/jobrunner/jobrunner.conf.erb
@@ -25,6 +25,12 @@
"refreshLinks"
]
},
+ "html": {
+ "runners": <%= @runners_html %>,
+ "include": [
+ "htmlCacheUpdate"
+ ]
+ },
"gwt": {
"runners": <%= @runners_gwt %>,
"include": [
--
To view, visit https://gerrit.wikimedia.org/r/265438
To unsubscribe, visit https://gerrit.wikimedia.org/r/settings
Gerrit-MessageType: merged
Gerrit-Change-Id: I180856917b5c74437e10e4c9b45e4e0a2ea1e381
Gerrit-PatchSet: 3
Gerrit-Project: operations/puppet
Gerrit-Branch: production
Gerrit-Owner: Ori.livneh <[email protected]>
Gerrit-Reviewer: Aaron Schulz <[email protected]>
Gerrit-Reviewer: Ori.livneh <[email protected]>
Gerrit-Reviewer: jenkins-bot <>
_______________________________________________
MediaWiki-commits mailing list
[email protected]
https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
