Faidon Liambotis has submitted this change and it was merged.
Change subject: Bug 54406: Speed up Parsoid job processing
......................................................................
Bug 54406: Speed up Parsoid job processing
Parsoid jobs were not dequeued fast enough to keep up during heavy editing.
The API load has been hovering around 30%, which leaves some room for higher
Parsoid dequeue rates.
This patch doubles the peak dequeue rate for Parsoid jobs. This will increase
the load on the API cluster by at most ~10%, likely closer to 5%. We'll
monitor the load on deployment.
Change-Id: I1a9aa38b2ef7f1eac6bba9c516690b2b1452a276
---
M modules/mediawiki/templates/jobrunner/jobs-loop.sh.erb
1 file changed, 1 insertion(+), 1 deletion(-)
Approvals:
Aaron Schulz: Looks good to me, but someone else must approve
Faidon Liambotis: Looks good to me, approved
jenkins-bot: Verified
diff --git a/modules/mediawiki/templates/jobrunner/jobs-loop.sh.erb
b/modules/mediawiki/templates/jobrunner/jobs-loop.sh.erb
index 6c2426e..3304b56 100755
--- a/modules/mediawiki/templates/jobrunner/jobs-loop.sh.erb
+++ b/modules/mediawiki/templates/jobrunner/jobs-loop.sh.erb
@@ -211,7 +211,7 @@
hpriotypes="$hpriotypes uploadFromUrl" # upload
(runJobsLoopService "$hpriotypes" "y" <%= dprioprocs %>) &
# Start loops for highly I/O bound jobs that work on special services
(e.g. not the DBs)
- (runJobsLoopService "ParsoidCacheUpdateJob" "n" <%=
procs_per_iobound_type %>) &
+ (runJobsLoopService "ParsoidCacheUpdateJob" "n" $((<%=
procs_per_iobound_type %> * 2)) ) &
fi
wait
--
To view, visit https://gerrit.wikimedia.org/r/86745
To unsubscribe, visit https://gerrit.wikimedia.org/r/settings
Gerrit-MessageType: merged
Gerrit-Change-Id: I1a9aa38b2ef7f1eac6bba9c516690b2b1452a276
Gerrit-PatchSet: 1
Gerrit-Project: operations/puppet
Gerrit-Branch: production
Gerrit-Owner: GWicke <[email protected]>
Gerrit-Reviewer: Aaron Schulz <[email protected]>
Gerrit-Reviewer: Faidon Liambotis <[email protected]>
Gerrit-Reviewer: GWicke <[email protected]>
Gerrit-Reviewer: jenkins-bot
_______________________________________________
MediaWiki-commits mailing list
[email protected]
https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
