dcausse moved this task from In Progress to Needs review on the Discovery-Search (Current work) board. dcausse added a comment.
The updater with flink 1.16 did run for about 3 days in yarn, notable change is that it required 5g of mem to run without failure during backfills. Current task_manager limits on k8s is at 2500M so this means doubling this value for both data centers and both jobs (~15G in each DC). There might be lower values that work but it might require tuning every components individually so if the mem is available I'd be for just increasing the mem limits. TASK DETAIL https://phabricator.wikimedia.org/T289836 WORKBOARD https://phabricator.wikimedia.org/project/board/1227/ EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: dcausse Cc: bking, dcausse, Aklapper, Mohamed-Awnallah, Adamm71, Jersione, Hellket777, LisafBia6531, Astuthiodit_1, AWesterinen, 786, BTullis, Biggs657, karapayneWMDE, Invadibot, MPhamWMF, Ywats0ns, maantietaja, Juan90264, Alter-paule, Beast1978, CBogen, ItamarWMDE, Un1tY, Akuckartz, Hook696, Kent7301, holger.knust, joker88john, CucyNoiD, Nandana, Namenlos314, Gaboe420, Giuliamocci, Cpaulf30, Lahi, Gq86, Af420, Bsandipan, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Lewizho99, Maathavan, _jensen, rosalieper, Neuronton, Scott_WUaS, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, GWicke, Manybubbles, Mbch331
_______________________________________________ Wikidata-bugs mailing list -- [email protected] To unsubscribe send an email to [email protected]
