Deal with duplicates in Flume with a crash.

[Guillermo Ortiz]

Hi,

I would like to know if there's a easy way to deal with data
duplication when an agent crashs and it resends same data again.

Is there any mechanism to deal with it in Flume,