| Mathew.onipe created this task. Mathew.onipe added projects: Operations, Wikidata-Query-Service, Discovery-Search (Current work). Restricted Application added a subscriber: Aklapper. Restricted Application added a project: Wikidata. |
On Saturday (06/10/2018), I Noticed a lot of Icinga alert about lag issues on wdqs2003. I depooled the restarted blazegraph and updater as usual but the lag issues only got worse. I called on @Gehel and he recommend that I temporary depool it. On looking deeper he noticed the lag patter showing in grafana (https://grafana.wikimedia.org/dashboard/db/wikidata-query-service?orgId=1&panelId=8&fullscreen&refresh=1m) was linear and non-random as the usual. Meanwhile after depooling, lag issues slowed down and Gehel repooled back. We didn't see any Lag issues until this morning When I noticed Stas has temp depooled again.
However, as of the time of writing this, I had to repool back as the Lag issues seems to be creeping on wdqs200[1-2] (Not sure if that was the right thing to do)
Cc: Smalyshev, Mathew.onipe, Gehel, Aklapper, Nandana, AndyTan, Davinaclare77, Qtn1293, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Th3d3v1ls, Hfbn0, QZanden, EBjune, merbst, LawExplorer, Zppix, Jonas, Xmlizer, Wong128hk, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, faidon, Mbch331, Jay8g, fgiunchedi
_______________________________________________ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
