Gehel created this task. Gehel added projects: Wikidata-Query-Service, Operations, Wikimedia-Logstash. Restricted Application added a subscriber: Aklapper. Restricted Application added a project: Wikidata. |
TASK DESCRIPTION
We recently had cases of wdqs sending >10K logs per seconds to logstash. This overloads logstash and should be avoided.
We should probably rate limit by logger / message template.
logback does not seem to provide this kind of functionality out of the box (the closest to that is the DuplicateMessageFilter.
TASK DETAIL
EMAIL PREFERENCES
To: Gehel
Cc: Smalyshev, fgiunchedi, Gehel, Aklapper, AndyTan, Davinaclare77, Qtn1293, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Th3d3v1ls, Hfbn0, QZanden, EBjune, merbst, LawExplorer, Zppix, Jonas, Xmlizer, Wong128hk, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, faidon, Mbch331, Jay8g, jeremyb
Cc: Smalyshev, fgiunchedi, Gehel, Aklapper, AndyTan, Davinaclare77, Qtn1293, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Th3d3v1ls, Hfbn0, QZanden, EBjune, merbst, LawExplorer, Zppix, Jonas, Xmlizer, Wong128hk, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, faidon, Mbch331, Jay8g, jeremyb
_______________________________________________ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs