Xin created KAFKA-16050:
---------------------------
Summary: consumer was removed from group，but still can poll data
from kafka, data duplicate
Key: KAFKA-16050
URL: https://issues.apache.org/jira/browse/KAFKA-16050
Project: Kafka
Issue Type: Bug
Components: core
Affects Versions: 2.3.1
Reporter: Xin
I have 3 brokers: b1,b2,b3
a topic : test, partitiion5,replication3
3 consumer in 1 group: consumer1,consumer2,consumer3
groupid: xx
consumer1 running in b1
consumer2 running in b2
consumer3 running in b3
./kafka-console-consumer.sh --bootstrap-server localhost:9093 --group xx
--topic test --from-beginning
b2's clock changed, consumer2 was removed from group xx(reason: removing
member consumer-2 on heartbeat expiration)
(kafka.coordinator.group.GroupCoordinator)
kafka-consumer-groups.sh can't see any record about cosumer2
./kafka-consumer-groups.sh --bootstrap-server localhost:9093 --all-topics
--describe --all-groups
Then consumer rebalanced, partiitons assigned to consumer2 was assigned to
other consumer
Although consumer2 was removed from group xx ,BUT still poll data from kafka
,kafka can't find it
After rebalance another consumer poll the same partition with consumer2
This make data was poll duplicate
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
