| Addshore added a comment. |
So, the increase to 25% of edits triggering jobs seems to be adding between 2 and 2.5 jobs per second to the queue (estimation prior was 1.6-4.1).
Job concurrency is now at about 6.
Default low volume queue concurrency is 50 per https://github.com/wikimedia/mediawiki-services-change-propagation-jobqueue-deploy/blob/master/scap/vars.yaml#L101
So getting this to 100% without hitting the limit should be no problem.
I appears there is so no deduplication happening yet, probably down to the fact that we are only at 25% so edits to the same entities in rapid succession may not currently be getting jobs triggered, the queue is also staying empty and jobs are being processed in 1-2s.
The QPS on the wdqs-internal cluster has increased from 50ops to 150ops due to the increased number of constraint checks.
F27988359: image.png
Cc: Stashbot, MisterSynergy, Lydia_Pintscher, gerritbot, Pchelolo, Addshore, Aklapper, CucyNoiD, Nandana, NebulousIris, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Adik2382, Jayprakash12345, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Zoranzoki21, merbst, LawExplorer, Lewizho99, Maathavan, DatGuy, Devwaker, Niklitov, _jensen, Urbanecm, Agabi10, JEumerus, Jonas, Tulsi_Bhagat, Wong128hk, Luke081515, Eevans, SimmeD, mobrovac, Hardikj, Wikidata-bugs, Snowolf, aude, Dcljr, Jdforrester-WMF, Matanya, Mbch331, Rxy, Jay8g, Krenair
_______________________________________________ Wikidata-bugs mailing list [email protected] https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
