Hi, We are using Apache Storm for a couple of years, and everything was fine till now. For our spout we are using “storm-kafka-0.9.4.jar”.
Lately, our “Failed” number of events has increased dramatically, and currently almost 20% of our total events are marked as Failed. We tried investigating our Topology logs, but we came up empty handed. Moreover, our spout complete latency is 25.996 ms. We suspected that our db is under a heavy load, so we increased our message timeout t0 60 and even 300 seconds, but that had no affect on the number of failures. Lowering our max pending value has produced a negative result. At some point, since we are not using anchoring, we thought about adding anchoring, but we saw that the KafkaSpout handles failures by replaying them, so we were not sure whether to add it or not. It would be helpful if you can direct us as to where we can find in Storm logs the reason for these failures, if there’s an exception which is not caught, maybe a time out, since we are a bit blind at the moment. We would appreciate any help with that. Thanks in advance, Yovav
