Hi, I'm working on a Trident/Kafka Topology which uses a OpaqueTridentKafkaSpout. I'm currently trying to obtain some metrics about this topology ( number of tuples emitted by the OpaqueTridentKafkaSpout, process time for each spout/bolt, ...)
I first tried to use Storm UI and the REST API but the number of tuples emitted by the spout was increasing really fast even though I had no messages in Kafka. The REST API shows me that my bolts are also emitting tuples, but when I try to log something in one of these bolts to see what tuple is being processed, nothing is logged at all. After some searches, these "invisible" tuples seems to come from https://github.com/apache/incubator-storm/blob/b2a8a77c3b307137527c706d0cd7635a6afe25bf/storm-core/src/clj/backtype/storm/daemon/task.clj#L164 I'm a total stranger to Clojure, so i'm just guessing... These tuples are counted in the metrics and my "legit" tuples metrics are lost in all the tuples metrics. How can I get metrics only for Kafka messages tuples? Thanks for your help, Guillaume.
