| Gehel created this task. Gehel added projects: Wikidata-Query-Service, Discovery-Wikidata-Query-Service-Sprint, Operations. Herald added a subscriber: Aklapper. Herald added projects: Wikidata, Discovery. |
TASK DESCRIPTION
We regularly observe clients of Wikidata Query Service which go way over our throttling limits for a long time. For example, we currently have what looks like a bot, generating HTTP 429 at a rate of ~300/minute, clearly ignoring the rate limit and the "Retry-After" headers. While this is not a major problem (throttled requests are cheap), it is still a concern, since our throttling mechanism does not share state across the cluster. It allows such a bot to max out its throttling limit on each node.
One proposed approach would be to entirely ban such a user for a period of time, if it is obvious that the behaviour can be considered as abusive. For example, a bot generating more than 200 requests per seconds during 1h would be banned for 24h.
TASK DETAIL
EMAIL PREFERENCES
To: Gehel
Cc: Smalyshev, Gehel, Aklapper, Davinaclare77, Qtn1293, Lahi, Gq86, Darkminds3113, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Th3d3v1ls, Hfbn0, QZanden, EBjune, merbst, LawExplorer, Avner, Zppix, Jonas, FloNight, Xmlizer, Wong128hk, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, faidon, Mbch331, Jay8g, fgiunchedi
Cc: Smalyshev, Gehel, Aklapper, Davinaclare77, Qtn1293, Lahi, Gq86, Darkminds3113, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Th3d3v1ls, Hfbn0, QZanden, EBjune, merbst, LawExplorer, Avner, Zppix, Jonas, FloNight, Xmlizer, Wong128hk, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, faidon, Mbch331, Jay8g, fgiunchedi
_______________________________________________ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
