https://bugzilla.wikimedia.org/show_bug.cgi?id=48164
Web browser: ---
Bug ID: 48164
Summary: JobQueue does not scale for TTMServer
Product: MediaWiki extensions
Version: master
Hardware: All
OS: All
Status: NEW
Severity: critical
Priority: Unprioritized
Component: Translate
Assignee: [email protected]
Reporter: [email protected]
CC: [email protected], [email protected],
[email protected], [email protected],
[email protected]
Classification: Unclassified
Mobile Platform: ---
So yesterday we got a report that Special:Translations is not working on meta.
I looked few ganglia stats but could not figure out anything specific.
Today with help of Max we have a theory:
Many concurrent updates slow solr down to crawling (1 every 2 seconds taking
average of almost 20 s to finish). Also search requests take longer than 10
seconds and time out.
The JobQueue seems to actually work against us here. The lack of accessible
statistics to examine JobQueue behavior is problematic.
Max proposed that we store the list of changes and use cronjob to push them in
batches with a single thread.
No other solutions have been proposed.
RT-5085 should be related to this.
--
You are receiving this mail because:
You are the assignee for the bug.
You are on the CC list for the bug.
_______________________________________________
Wikibugs-l mailing list
[email protected]
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
