I finally found the root cause. Turns out the spout was reading a message exceeded the max message size. After increasing the message size in SpoutConfig, it worked. It would have been nice if the Spout threw an error or exception in such cases.
Jing On May 16, 2014, at 12:09 PM, "Tao, Jing" <[email protected]<mailto:[email protected]>> wrote: Hi, I am using storm 0.9.0.1, kafka 0.8, and storm-kafka-0.8-plus. In LocalCluster, after fetching and processing about 18,000 messages, the spout stops fetching from Kafka even though there are new messages in the queue. There are no errors in the storm or kafka logs. Any idea why this is happening? Thanks, Jing
