Urmi Mustafi created GOBBLIN-1934:
-------------------------------------
Summary: Monitor High Level Consumer queue size
Key: GOBBLIN-1934
URL: https://issues.apache.org/jira/browse/GOBBLIN-1934
Project: Apache Gobblin
Issue Type: Improvement
Components: gobblin-service
Reporter: Urmi Mustafi
Assignee: Abhishek Tiwari
We suspect that the HighLevelConsumer class may be dropping Kafka messages if
the thread for a particular consumption queue is interrupted or stalled. Before
changing how these queues are handled, we want to verify that blocked or
dropped queues is the reason for missed messages by emitting metrics about each
queue's size.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
