how to split one event to many

hi all: i want to split one source log to many sinks, but i don't know how and where to split it. Thanks for regards. here is a sample: sources: a b,c,d sinks(three): a,b a,c a,d lizhenm...@163.com

Re: how to split one event to many

Create a channel for each sink and then link the source to the 3 channels instead of just one Regards, Gonzalo On 27 October 2015 at 07:08, lizhenm...@163.com wrote: > > hi all: > i want to split one source log to many sinks, but i don't know how and > where to split it. Thanks for regards.

[jira] [Commented] (FLUME-2829) Taildir Source doesn't populate Filename

[ https://issues.apache.org/jira/browse/FLUME-2829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14975953#comment-14975953 ] Andre commented on FLUME-2829: -- Iijima san It is an option. The only challenge with that a

Re: Re: how to split one event to many

thank to Gonzalo, but that is just a sample, the one event maybe split to 10,100... lizhenm...@163.com From: Gonzalo Herreros Date: 2015-10-27 16:18 To: Flume CC: user Subject: Re: how to split one event to many Create a channel for each sink and then link the source to the 3 channels instead

Re: Re: how to split one event to many

I don't think that is possible, Flume needs the Sinks defined beforehand and 100 is not manageable. If you really need that many destinations, create a custom Sink that extends the one you are interested into and sends it to multiple configurable destinations (you are likely to have other problems

[jira] [Updated] (FLUME-2827) Duplicate declaration of hadoop-minicluster dependency

[ https://issues.apache.org/jira/browse/FLUME-2827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Edward Maxwell-Lyte updated FLUME-2827: --- Attachment: (was: 0001-FLUME-2827-0.patch) > Duplicate declaration of hadoop-minic

[jira] [Updated] (FLUME-2827) Duplicate declaration of hadoop-minicluster dependency

[ https://issues.apache.org/jira/browse/FLUME-2827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Edward Maxwell-Lyte updated FLUME-2827: --- Attachment: FLUME-2827-0.patch > Duplicate declaration of hadoop-minicluster dependenc

[jira] [Updated] (FLUME-2827) Duplicate declaration of hadoop-minicluster dependency

[ https://issues.apache.org/jira/browse/FLUME-2827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Edward Maxwell-Lyte updated FLUME-2827: --- Component/s: Technical Debt > Duplicate declaration of hadoop-minicluster dependency >

[jira] [Updated] (FLUME-2827) Duplicate declaration of hadoop-minicluster dependency

[ https://issues.apache.org/jira/browse/FLUME-2827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Edward Maxwell-Lyte updated FLUME-2827: --- Affects Version/s: v1.6.0 > Duplicate declaration of hadoop-minicluster dependency > -

[jira] [Created] (FLUME-2830) Is there something wrong in the 'Flume User Guide'?

ruochen zuo created FLUME-2830: -- Summary: Is there something wrong in the 'Flume User Guide'? Key: FLUME-2830 URL: https://issues.apache.org/jira/browse/FLUME-2830 Project: Flume Issue Type: Que

Re: Review Request 39035: FLUME-2712: Optional channel errors slows down the Source to Main channel event rate

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/39035/ --- (Updated Oct. 28, 2015, 12:10 a.m.) Review request for Flume. Bugs: FLUME-271

[jira] [Updated] (FLUME-2712) Optional channel errors slows down the Source to Main channel event rate

[ https://issues.apache.org/jira/browse/FLUME-2712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Johny Rufus updated FLUME-2712: --- Attachment: FLUME-2712-1.patch Attaching patch with the test case and single thread of execution for

[jira] [Commented] (FLUME-2815) OrderSelector may lead to no sink to use.

[ https://issues.apache.org/jira/browse/FLUME-2815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14977595#comment-14977595 ] tcltsh commented on FLUME-2815: --- any body here? > OrderSelector may lead to no sink to use.