Hari Shreedharan created FLUME-2173:
---------------------------------------
Summary: Exactly once semantics for Flume
Key: FLUME-2173
URL: https://issues.apache.org/jira/browse/FLUME-2173
Project: Flume
Issue Type: Bug
Reporter: Hari Shreedharan
Currently Flume guarantees only at least once semantics. This jira is meant to
track exactly once semantics for Flume. My initial idea is to include uuid
event ids on events at the original source (use a config to mark a source an
original source) and identify destination sinks. At the destination sinks, use
a unique ZK Znode to track the events. If once seen (and configured), pull the
duplicate out.
This might need some refactoring, but my belief is we can do this in a backward
compatible way.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
