Addshore added a comment.
The tuning when in crisis is probably a more accurate description of what we want to aim for, be that automatically or manually. The issue of wdqs updater should indeed be seen as a seperate issue, and that is being solved seperatly. Maxlag is currently the system being abused to allow for some sort of rate limit on the site as a whole. You could say we have been in a bit of a constant crisis over the last 6 months regarding expectations of the query service which is critical to many workflows and what the service was able to deliver. With that in mind though, why do we have maxlag at all? We have the same problem with pure maxlag, as demonstrated at the weekend when one of the S8 dB servers was overwhelmed with a lag of 9 for 12 hours. Another element of maxlag, the dispatch system, ended up coming in just about this at 15(I think) for the same period. But the effects of either of those systems reporting that value of maxlag is 0 edits by automated systems for a 12 hour period. That isn't really desired and instead being able to control concurrency could be seen as an answer. We could look at the issue this weekend again as an individual problem to fix, as with the query service, but as aliuded to above, there will always be more crisis situations where this mechanism would help. I can also see this from the other side of the fence, if we're in a situation where wikidata was negatively impacting enwiki, I imagine a response to that would be set Wikidata to read-only for a period, or use maxlag to slow down editing. However that isn't really desirable and having a control mechanism, rather than an on or off would be great. TASK DETAIL https://phabricator.wikimedia.org/T252091 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Addshore Cc: Joe, Dvorapa, daniel, Krinkle, Aklapper, Jakob_WMDE, Lydia_Pintscher, WMDE-leszek, darthmon_wmde, Addshore, Ladsgroup, DannyS712, Nandana, kostajh, Lahi, Gq86, GoranSMilovanovic, RazeSoldier, QZanden, LawExplorer, elukey, _jensen, rosalieper, D3r1ck01, Scott_WUaS, Jonas, Izno, SBisson, Perhelion, Wikidata-bugs, Base, aude, GWicke, Bawolff, jayvdb, fbstj, santhosh, Jdforrester-WMF, Mbch331, Rxy, Jay8g, Ltrlg, bd808, Legoktm
_______________________________________________ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
