Kevin Conaway created FLUME-2920:
------------------------------------
Summary: Kafka Channel Should Not Commit Offsets When Stopping
Key: FLUME-2920
URL: https://issues.apache.org/jira/browse/FLUME-2920
Project: Flume
Issue Type: Bug
Components: Channel
Affects Versions: v1.6.0
Reporter: Kevin Conaway
Priority: Critical
The Kafka channel commits the consumer offsets when shutting down (via stop()
-> decommissionConsumerAndRecords())
This can lead to data loss if the channel is shut down while messages have been
fetched in a transaction but the transaction has not yet been committed.
The only time that the offsets should be committed is when a transaction is
complete.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
