[ 
https://issues.apache.org/jira/browse/FLUME-2298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14168902#comment-14168902
 ] 

Ashish Paliwal commented on FLUME-2298:
---------------------------------------

Here is a working version 
https://github.com/paliwalashish/flume-cookbook/blob/master/src/main/java/com/ashishpaliwal/flume/channels/ReplicatingChannel.java

It's based on Hazelcast. There are lot of Distributed Queue implementations 
which can be used for this.

> Replication Channel
> -------------------
>
>                 Key: FLUME-2298
>                 URL: https://issues.apache.org/jira/browse/FLUME-2298
>             Project: Flume
>          Issue Type: New Feature
>          Components: Channel
>            Reporter: Ted Malaska
>            Assignee: Ted Malaska
>         Attachments: Flume Replication Channel Design.0.3.pdf, 
> FlumeDistributedChannelDesign.0.1.pdf, 
> FlumeDistributedChannelDesign.0.2.1.pdf, FlumeDistributedChannelDesign.0.2.pdf
>
>
> This channel will allow for events to be persisted with a plugable method on 
> more then one agent or node.  
> The goal is to gain the following benefits:
> 1. Events will continue to flow to sinks with out loss or with out large 
> delay even in the case of node failure.
> 2. Protect against loss in the case of a complete single node failure



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to