[ 
https://issues.apache.org/jira/browse/FLUME-2430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14105280#comment-14105280
 ] 

Tigran commented on FLUME-2430:
-------------------------------

Can you set-up metrics 
(https://flume.apache.org/FlumeUserGuide.html#json-reporting) and tell the 
result?

> Losing events with multiple agents flow
> ---------------------------------------
>
>                 Key: FLUME-2430
>                 URL: https://issues.apache.org/jira/browse/FLUME-2430
>             Project: Flume
>          Issue Type: Bug
>    Affects Versions: v1.5.0, v1.5.0.1
>         Environment: Win7 64bit, Cygwin
>            Reporter: Vitaly
>
> Not all events are delivered and persisted to file when using multi agent 
> flow:
>   
> agent1.sources = avroSource1
> agent1.sinks = avroSync
> agent1.channels = memoryChannel
> agent1.sources.avroSource1.type = avro
> agent1.sources.avroSource1.bind = localhost
> agent1.sources.avroSource1.port = 41414
> agent1.sinks.avroSync.type = avro
> agent1.sinks.avroSync.hostname = localhost
> agent1.sinks.avroSync.port = 4444
> agent1.channels.memoryChannel.type = memory
> agent1.channels.memoryChannel.capacity = 10000
> agent1.channels.memoryChannel.transactionCapacity = 1000
> agent1.sources.avroSource1.channels = memoryChannel
> agent1.sinks.avroSync.channel = memoryChannel
> agent2.sources = avroSource
> agent2.sinks = fileRollSink 
> agent2.channels = memoryChannel
> agent2.sources.avroSource.type = avro
> agent2.sources.avroSource.bind = localhost
> agent2.sources.avroSource.port = 4444
> agent2.sinks.fileRollSink.type = file_roll
> agent2.sinks.fileRollSink.sink.directory = C:\\Users\\flume\\flumeFileAgent
> agent2.sinks.fileRollSink.sink.rollInterval=0
> agent2.channels.memoryChannel.type = memory
> agent2.channels.memoryChannel.capacity = 10000
> agent2.channels.memoryChannel.transactionCapacity = 1000
> agent2.sources.avroSource.channels = memoryChannel
> agent2.sinks.fileRollSink.channel = memoryChannel
> For example I am passing 1000 events to the first "agent1" but "agent2" 
> doesn't receive from "agent1" all of them, only 800 or 700 are stored in 
> file. No exceptions are thrown by flume agents.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Reply via email to