Lucas_Werkmeister_WMDE added a comment.
In T239931#6331040 <https://phabricator.wikimedia.org/T239931#6331040>, @Ladsgroup wrote: > In T239931#6330953 <https://phabricator.wikimedia.org/T239931#6330953>, @CBogen wrote: > >> @addshore do you know if the load has been reduced enough that this is no longer an issue? > > The load has been reduced (we dropped the old term store and the new one is heavily and properly cached) but I recommend turning this on with a slower pace than it used to be or (more preferably and highly recommended) make the sanitizer job not depend on the HTML output of the page (e.g. by having a dedicated sanitizer job for wikibase), It only loads HTML of the page because the job is the same with Wikipedia while it doesn't need it (unlike Wikipedia) and such redundant process is pretty expensive in matter of CPU and DB queries, almost 30%-50% of ParserCache storage everywhere was due to this job. If we no longer use the HTML in the sanitizer (see the above changes), do we still need a gradual ramp-up when reenabling the sanitizer or is it okay to turn it back on immediately? (I’m not sure if a gradual ramp-up would be possible without code changes to CirrusSearch – currently `CirrusSearchSanityCheck` is just a boolean flag.) TASK DETAIL https://phabricator.wikimedia.org/T239931 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Lucas_Werkmeister_WMDE Cc: Lucas_Werkmeister_WMDE, tfmorris, Pintoch, CBogen, EBernhardson, Ladsgroup, Addshore, Aklapper, dcausse, Wilmanbeno, Alter-paule, Beast1978, Un1tY, Akuckartz, Hook696, darthmon_wmde, Kent7301, joker88john, CucyNoiD, Nandana, Gaboe420, Giuliamocci, Cpaulf30, Lahi, Gq86, Af420, Bsandipan, GoranSMilovanovic, QZanden, EBjune, LawExplorer, Lewizho99, Maathavan, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, jayvdb, Mbch331, jeremyb
_______________________________________________ Wikidata-bugs mailing list [email protected] https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
