[
https://issues.apache.org/jira/browse/FLUME-2298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13870727#comment-13870727
]
Ted Malaska commented on FLUME-2298:
------------------------------------
I'm working on a design now and I'm getting it reviewed by Hari. When it is
done I will post it to the Jira in the form of a PDF.
If you have design feel free to post them. It is very possible parts or the
whole of the idea may make it into the final design.
Right now at a high level I'm working on a master slave design. When master's
go down slaves become active and then empty out. If slaves go down they are
re-replicated on another agent. The data does have to go over the network for
the put but only the commands have to go over the network for the take and
commit.
Also if you are interested maybe we can talk next week over webex to iron out
details.
> Distributed Channel
> -------------------
>
> Key: FLUME-2298
> URL: https://issues.apache.org/jira/browse/FLUME-2298
> Project: Flume
> Issue Type: New Feature
> Components: Channel
> Reporter: Ted Malaska
> Assignee: Ted Malaska
>
> This channel will allow for events to be persisted with a plugable method on
> more then one agent or node.
> The goal is to gain the following benefits:
> 1. Events will continue to flow to sinks with out loss or with out large
> delay even in the case of node failure.
> 2. Protect against loss in the case of a complete single node failure
--
This message was sent by Atlassian JIRA
(v6.1.5#6160)
