Otavio Rodolfo Piske created CAMEL-18717:
--------------------------------------------

             Summary: camel-kafka: investigate offset not increasing
                 Key: CAMEL-18717
                 URL: https://issues.apache.org/jira/browse/CAMEL-18717
             Project: Camel
          Issue Type: Bug
          Components: camel-kafka
    Affects Versions: 3.18.3
            Reporter: Otavio Rodolfo Piske
            Assignee: Otavio Rodolfo Piske


Quoting the report from an user on the users mailing list:

 

??Hi All,??

??I'm upgrading Camel from 3.16 to 3.17 and found a problem that 
OffsetRepository didn't get update after manual commit.??
??It is a Spring boot project and MemoryStateRepository as follows.??

??        @Bean??
??        public MemoryStateRepository offsetRepo() {??
??                MemoryStateRepository stateRepository = new 
MemoryStateRepository();??
??                stateRepository.setState(topic + "/0", "");??
??                return stateRepository;??
??        }??

??Here is the method I use when commit:??

??        private void commitOffsetToKafka(Exchange exchange) {??
??                KafkaManualCommit manual = 
exchange.getIn().getHeader(KafkaConstants.MANUAL_COMMIT, 
KafkaManualCommit.class);??
??                manual.commit();??
??        }??

??Here is my Kafka endpoint??

??kafka:integration_test 
_topic?brokers=[127.0.0.1:41478|http://127.0.0.1:41478/]&autoCommitEnable=false&allowManualCommit=true&seekTo=beginning&maxPollRecords=2&groupId=ANE&autoOffsetReset=earliest&offsetRepository=#offsetRepo&kafkaManualCommitFactory=#class:org.apache.camel.component.kafka.consumer.DefaultKafkaManualCommitFactory??

??It is working fine in 3.16. When DefaultkafkaManualSyncCommit.commit() is 
invoked. The offsetRepository.setState() get invoked so the offset increased.??
??However, in 3.17, DefaultkafkaManualSyncCommit.commit() doesn't have a 
reference to offsetRepository so the offset in offsetRepository won't get 
increased.??

??Is this a bug or there is a different way to get the offset after committing. 
Could you please suggest what I should do to test if the offset get increased 
after manual commit???

 

This happened even after upgrading to Camel 3.18.3 as requested on the ticket.

 

This needs to be investigated further.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to