Getting fixed amount of messages using Zookeeper based consumer

[Vaibhav Puranik]

Hi all,

Is there any way to get a fixed amount of messages using Zookeeper based
consumer (ConsumerConnector)?

I know that with SimpleConsumer you can pass fetchSize as an argument and
limit the number of messages coming back.

This sample code creates 4 threads that keep consuming forever.

// consume the messages in the threads
for(final KafkaStream<Message> stream: streams) {
  executor.submit(new Runnable() {
    public void run() {
      for(MessageAndMetadata msgAndMetadata: stream) {
        // process message (msgAndMetadata.message())
      } 
    }
  });
}

Regards,
Vaibhav