Rodolfo Ribeiro SIlva created STORM-2607:
--------------------------------------------
Summary: consumer group every time with lag 1
Key: STORM-2607
URL: https://issues.apache.org/jira/browse/STORM-2607
Project: Apache Storm
Issue Type: Bug
Components: storm-kafka-client
Reporter: Rodolfo Ribeiro SIlva
Priority: Minor
When i put a message a partition, the storm-kafka-client consume this message.
But storm-kafka-client commit the offset -1.
storm-kafka-client: 1.1.0
storm-core : 1.1.0
kafka: 0.10.2.0
Steps to bug
#1 - Insert message in kafka
#2 - Read with storm Spout this topic
#3 - Get the offset for the consumer group and the offset is always offset -1
The KafkaSpoutConfig
protected static KafkaSpoutConfig<String, String> newKafkaSpoutConfig() {
return KafkaSpoutConfig.builder("192.168.57.11:9092", "topic").
setGroupId("storm").setOffsetCommitPeriodMs(10_000).
setMaxUncommittedOffsets(100_0000).setRetry(newRetryService())
.build();
}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
