Akosiaris has submitted this change and it was merged.
Change subject: Bug 55418: Add job runners for new Parsoid job types
......................................................................
Bug 55418: Add job runners for new Parsoid job types
Parsoid jobs are now split in two queues:
1) Re-parses of an edited page itself
2) Updates to pages transcluding a page (or template) or an image
The second has a lower priority and is more expensive, while the first is
important for avoiding cache misses in the Parsoid Varnishes.
Change-Id: I60d2d179c3d5805b8b5d6e45a4f14904bf1bebdb
---
M modules/mediawiki/templates/jobrunner/jobs-loop.sh.erb
1 file changed, 9 insertions(+), 1 deletion(-)
Approvals:
Akosiaris: Looks good to me, approved
jenkins-bot: Verified
diff --git a/modules/mediawiki/templates/jobrunner/jobs-loop.sh.erb
b/modules/mediawiki/templates/jobrunner/jobs-loop.sh.erb
index 3304b56..828eef9 100755
--- a/modules/mediawiki/templates/jobrunner/jobs-loop.sh.erb
+++ b/modules/mediawiki/templates/jobrunner/jobs-loop.sh.erb
@@ -210,8 +210,16 @@
hpriotypes="$hpriotypes TranslateRenderJob TranslateMoveJob
TranslateDeleteJob" # translate
hpriotypes="$hpriotypes uploadFromUrl" # upload
(runJobsLoopService "$hpriotypes" "y" <%= dprioprocs %>) &
+
# Start loops for highly I/O bound jobs that work on special services
(e.g. not the DBs)
- (runJobsLoopService "ParsoidCacheUpdateJob" "n" $((<%=
procs_per_iobound_type %> * 2)) ) &
+
+ # Legacy Parsoid jobs. TODO: Remove once this queue is drained.
+ (runJobsLoopService "ParsoidCacheUpdateJob" "n" <%=
procs_per_iobound_type %> ) &
+ # Lower priority for Parsoid dependency changes (template / file
+ # updates)
+ (runJobsLoopService "ParsoidCacheUpdateJobOnDependencyChange" "n" <%=
procs_per_iobound_type %> ) &
+ # High priority for updates to edited pages themselves
+ (runJobsLoopService "ParsoidCacheUpdateJobOnEdit" "n" $((<%=
procs_per_iobound_type %> * 2)) ) &
fi
wait
--
To view, visit https://gerrit.wikimedia.org/r/90268
To unsubscribe, visit https://gerrit.wikimedia.org/r/settings
Gerrit-MessageType: merged
Gerrit-Change-Id: I60d2d179c3d5805b8b5d6e45a4f14904bf1bebdb
Gerrit-PatchSet: 3
Gerrit-Project: operations/puppet
Gerrit-Branch: production
Gerrit-Owner: GWicke <[email protected]>
Gerrit-Reviewer: Aaron Schulz <[email protected]>
Gerrit-Reviewer: Akosiaris <[email protected]>
Gerrit-Reviewer: GWicke <[email protected]>
Gerrit-Reviewer: jenkins-bot
_______________________________________________
MediaWiki-commits mailing list
[email protected]
https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
