As I recall, the Kafka spout reported metrics that could be seen if you attach a LoggingMetricsConsumer. Once you find them and determine they meet your needs, you’ll want to report them somewhere that you can visualize and alert.
Joshua On Tue, Aug 21, 2018 at 3:18 AM Shaik Asifullah <[email protected]> wrote: > Hi, > I am using Apache Storm Trident (1.2.1) for micro-batching. The main idea > of my topology is to modify messages from Kafka a little and push it to > Database. I am using KafkaSpoutOpaque for one time semantics. Can someone > please suggest regarding monitoring the topology for Kafka Consumer Lags. I > realised that I cannot be using storm-kafka-monitor since offsets for > Trident topologies are maintained in Storm Zookeeper rather than Kafka > Zookeeper. Is there anyway to solve this? > > Thanks, > Shaik Asifullah >
