Data is indeed received with a timestamp, that is how I noticed that there are sometimes duplicates.
Thanks for being great and swift help, really appreciated. -Marc - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -. F1 Outsourcing Development Sp. z o.o. Poland t: +48 (0)124466845 f: +48 (0)124466843 e: [email protected] -----Original Message----- From: Matthias J. Sax [mailto:[email protected]] Sent: maandag 31 augustus 2015 9:27 To: [email protected] Subject: Re: Removing duplicates Sounds reasonable. Storm does not provide any help with this. I assume that your sensors attach a timestamp as regular attribute to each tuple. Or do you timestamp your date in spout? -Matthias On 08/31/2015 09:11 AM, Marc Roos wrote: > > I have sensors that seem to be emitting duplicates and not ordered data. > I was thinking of creating an extra bolt that can deduplicate. Or is > this this something I should try in fix in the spout itself? > > Does storm offer some help in detecting duplicates (timestamps)? > > > > > - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -. > F1 Outsourcing Development Sp. z o.o. > Poland > > t: +48 (0)124466845 > f: +48 (0)124466843 > e: [email protected] > > >
