Re: Message polling behavior when subscribed to a topic pattern

2017-05-11 Thread Stevo Slavić
Hello William, You have overriden KafkaConsumer's max.poll.records configuration, to return only up to 10 records in single call to poll, so it does that. Fetcher iterates over completed fetch responses and in first one(s) from single topic finds enough of records to satisfy max limit. See

Message polling behavior when subscribed to a topic pattern

2017-05-11 Thread William Yu
Hi, I'm trying to understand the behavior of consumer poll function when subscribed to multiple topics using a RegEx topic pattern. I was under the assumption the poll function would pull messages from each of the topics I was subscribed to, but from a test program I wrote it looks like it will