A Design Question that needs verification:
1. Created a topic T with 'n' partitions.
2. Created a consumer group process with 'n + 1' threads subscribing from
topic 'T' with a groupID 'y'
3. Added another consumer group process with 'n + 1' threads subscribing
from same topic 'T' with same
I think you are hitting this -
https://cwiki.apache.org/confluence/display/KAFKA/FAQ#FAQ-Whysomeoftheconsumersinaconsumergroupneverreceiveanymessage%3F
Let us know if we can improve the documentation to make it clearer.
Thanks,
Neha
On Wed, Sep 11, 2013 at 5:28 PM, prashant amar
Also noticed another issue
Specified below is the current configuration
Topic1 - n Partitions - 2 Consumer Groups (gr1 and gr2)
Topic2 - n Partitions - 2 Consumer Groups (gr1 and gr2)
Notice that I have used the same naming convention on the consumer group
set i.e. 'gr1' and 'gr2' are consumer
This means the broker somehow closed the socket connection. Anything in the
broker log around the same time?
Thanks,
Jun
On Wed, Sep 11, 2013 at 6:07 PM, prashant amar amasin...@gmail.com wrote:
Also noticed another issue
Specified below is the current configuration
Topic1 - n Partitions
From the broker log:
INFO Reconnect due to socket error: (kafka.consumer.SimpleConsumer)
java.nio.channels.ClosedChannelException
at kafka.network.BlockingChannel.send(BlockingChannel.scala:89)
at kafka.consumer.SimpleConsumer.liftedTree1$1(SimpleConsumer.scala:72)
at
I usually get this exception when I define 2 partitions ..
Current configuration :
Single Topic - 4 partitions
1 Consumers Group - 10 Threads
On Wed, Sep 11, 2013 at 10:24 PM, prashant amar amasin...@gmail.com wrote:
From the broker log:
INFO Reconnect due to socket error:
