Re: Flume Event Ordering

2016-09-20 Thread Roshan Naik
You won¹t have *strict ordering* of events when you have more than 1 agent or source or sink or channel in play due to the concurrency involved. Ordering, if any, happens at the channel level. Although Flume does not guarantee any ordering, in practice, there are a few things worth noting for M

Re: Flume Event Ordering

2016-09-20 Thread Balazs Donat Bessenyei
Hi Sreeram, I wanted to say almost the same as Denes, with the addition that you can add Timestamp Interceptors ( https://flume.apache.org/FlumeUserGuide.html#timestamp-interceptor ) to your config / setup. Basically, you would add extra headers to events that are monotonous, so you can reorder th

Re: Flume Event Ordering

2016-09-20 Thread Denes Arvay
Hi Sreeram, No, Flume doesn't guarantee the order of event delivery. Flume has at least once guarantee (when configured properly), so duplicated events and out-of-order event delivery may occur. As a start I'd really recommend Hari Shreedharan's book about Flume. More info regarding to the guarant

Flume Event Ordering

2016-09-20 Thread Sreeram
Hi, I am a newbie to Flume and trying to understand more on the event ordering. I am interested in knowing if Flume provides ordering guarantee for the events from the source to destination. Kindly let me know. Regards, Sreeram