Addshore added a comment.
wdqs1006 now 8 hours lagged and depooled after I noticed it was not reporting on grafana after I was poked about wdqs being very behind. I'll keep checking back throughout the day and repool later. We should get T250140: icinga: WDQS high update lag should alert when the service times out <https://phabricator.wikimedia.org/T250140> done asap While it was out the lag on the other eqiad instances shot up, but maxlag didnt kick in as wdqs1006 wasnt reporting so the eqiad servers were basically ignored from the maxlag calculation T238751: Only generate maxlag from pooled query service servers. <https://phabricator.wikimedia.org/T238751> TASK DETAIL https://phabricator.wikimedia.org/T242453 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Addshore Cc: Addshore, dcausse, Aklapper, darthmon_wmde, Nandana, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
_______________________________________________ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs