[
https://issues.apache.org/jira/browse/FLUME-1198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13278646#comment-13278646
]
[email protected] commented on FLUME-1198:
------------------------------------------------------
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/5161/
-----------------------------------------------------------
(Updated 2012-05-18 08:02:10.859912)
Review request for Flume and Juhani Connolly.
Changes
-------
Added Jira link.
Summary
-------
Added a load-balancing sink processor that uses default round-robin policy to
select sinks from the group. In case of failure, it skips the sink and goes to
the next. Can be configured to use random distribution of load instead of
default round-robin semantics.
Also, this processor accepts implementations of sink selectors which can be
used to route the load into various sinks.
This addresses bug FLUME-1198.
https://issues.apache.org/jira/browse/FLUME-1198
Diffs
-----
/trunk/flume-ng-configuration/src/main/java/org/apache/flume/conf/sink/SinkProcessorType.java
1339941
/trunk/flume-ng-core/src/main/java/org/apache/flume/sink/AbstractSinkProcessor.java
PRE-CREATION
/trunk/flume-ng-core/src/main/java/org/apache/flume/sink/AbstractSinkSelector.java
PRE-CREATION
/trunk/flume-ng-core/src/main/java/org/apache/flume/sink/FailoverSinkProcessor.java
1339941
/trunk/flume-ng-core/src/main/java/org/apache/flume/sink/LoadBalancingSinkProcessor.java
PRE-CREATION
/trunk/flume-ng-core/src/test/java/org/apache/flume/sink/FixedOrderSelector.java
PRE-CREATION
/trunk/flume-ng-core/src/test/java/org/apache/flume/sink/SinkProcessorFactoryTest.java
1339941
/trunk/flume-ng-core/src/test/java/org/apache/flume/sink/TestLoadBalancingSinkProcessor.java
PRE-CREATION
Diff: https://reviews.apache.org/r/5161/diff
Testing
-------
Introduced new tests and ran all existing tests.
Thanks,
Arvind
> Implement a load-balancing sink processor
> -----------------------------------------
>
> Key: FLUME-1198
> URL: https://issues.apache.org/jira/browse/FLUME-1198
> Project: Flume
> Issue Type: Improvement
> Reporter: Arvind Prabhakar
> Assignee: Arvind Prabhakar
> Fix For: v1.2.0
>
> Attachments: BalancingSinkProcessor.java, FLUME-1198-2.patch
>
>
> A load-balancing sink processor that can distribute the load over multiple
> sinks. The distribution of load could be round/robin or random, preferably
> configurable to support both.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
