Hi Sreeram,

I wanted to say almost the same as Denes, with the addition that you
can add Timestamp Interceptors (
https://flume.apache.org/FlumeUserGuide.html#timestamp-interceptor )
to your config / setup.
Basically, you would add extra headers to events that are monotonous,
so you can reorder them when you are processing the ingested data.

Best regards,


On Tue, Sep 20, 2016 at 11:43 AM, Denes Arvay <de...@cloudera.com> wrote:
> Hi Sreeram,
> No, Flume doesn't guarantee the order of event delivery. Flume has at least
> once guarantee (when configured properly), so duplicated events and
> out-of-order event delivery may occur.
> As a start I'd really recommend Hari Shreedharan's book about Flume. More
> info regarding to the guarantees can be found in the "Flumeā€™s No Data Loss
> Guarantee, Channels, and Transactions" chapter:
> https://books.google.hu/books?id=tbOKBAAAQBAJ&lpg=PT44&ots=rqxvhy6jHq&hl=hu&pg=PT44#v=onepage&q&f=false
> If you have any other questions, feel free to ask, we are happy to help.
> Cheers,
> Denes
> On Tue, Sep 20, 2016 at 11:23 AM Sreeram <sreera...@gmail.com> wrote:
>> Hi,
>>  I am a newbie to Flume and trying to understand more on the event
>> ordering.
>>  I am interested in knowing if Flume provides ordering guarantee for the
>> events from the source to destination.
>>  Kindly let me know.
>> Regards,
>> Sreeram

Reply via email to