Smalyshev created this task.
Smalyshev added a project: Wikidata-Query-Service.
Restricted Application added a subscriber: Aklapper.
Restricted Application added a project: Wikidata.

TASK DESCRIPTION

Kafka poller lag reporting is inconsistent due to multiple topics being consumed by Kafka. Example:

https://grafana.wikimedia.org/dashboard/db/wikidata-query-service?orgId=1&var-cluster_name=wdqs-test&from=1538695337536&to=1538753694587

We should probably choose a single leading topic and report on it. In regular circumstances, this would not matter as we also record kafka offsets, so other topics' position would not be affected. If we switch from Kafka to RC poller though we may lose some events, but events on secondary topics may not be picked by RC poller anyway. So it could be an improvement.


TASK DETAIL
https://phabricator.wikimedia.org/T206359

EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Smalyshev
Cc: Aklapper, Gehel, Smalyshev, Nandana, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
_______________________________________________
Wikidata-bugs mailing list
[email protected]
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

Reply via email to