[
https://issues.apache.org/jira/browse/NIFI-15464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David Handermann updated NIFI-15464:
------------------------------------
Affects Version/s: 2.7.2
2.7.1
2.7.0
> ConsumeKafka processor causes duplicate message processing during consumer
> group rebalance due to missing offset commit in onPartitionsRevoked
> ----------------------------------------------------------------------------------------------------------------------------------------------
>
> Key: NIFI-15464
> URL: https://issues.apache.org/jira/browse/NIFI-15464
> Project: Apache NiFi
> Issue Type: Bug
> Affects Versions: 2.7.0, 2.7.1, 2.7.2
> Reporter: Pierre Villard
> Assignee: Pierre Villard
> Priority: Major
> Fix For: 2.8.0
>
> Time Spent: 1h 20m
> Remaining Estimate: 0h
>
> The new ConsumeKafka processor (using Kafka3ConnectionService) causes
> duplicate message processing when a consumer group rebalance occurs (e.g.,
> when a consumer starts or stops). Unlike the legacy ConsumeKafka_2_6
> processor which commits pending offsets during the onPartitionsRevoked
> callback, the new Kafka3ConsumerService only performs a rollback, causing
> uncommitted but already-processed messages to be reprocessed by other
> consumers in the group.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
