Hi Joshua, Thanks a lot for your help. If I could configure my topology with conf.registerMetricsConsumer(org.apache.storm.metrics.LoggingMetricsConsumer.class, 1); Will it work ? If not, can you please give me a little more understanding on enabling this since I am very new to Trident.
Best regards, Shaik Asifuallah On Tue, Aug 21, 2018 at 6:12 PM Joshua Martell <[email protected]> wrote: > As I recall, the Kafka spout reported metrics that could be seen if you > attach a LoggingMetricsConsumer. Once you find them and determine they meet > your needs, you’ll want to report them somewhere that you can visualize and > alert. > > Joshua > On Tue, Aug 21, 2018 at 3:18 AM Shaik Asifullah <[email protected]> > wrote: > >> Hi, >> I am using Apache Storm Trident (1.2.1) for micro-batching. The main idea >> of my topology is to modify messages from Kafka a little and push it to >> Database. I am using KafkaSpoutOpaque for one time semantics. Can someone >> please suggest regarding monitoring the topology for Kafka Consumer Lags. I >> realised that I cannot be using storm-kafka-monitor since offsets for >> Trident topologies are maintained in Storm Zookeeper rather than Kafka >> Zookeeper. Is there anyway to solve this? >> >> Thanks, >> Shaik Asifullah >> >
