The downstream operator doesn't seem to be failing and through some local tests I can confirm that each operator works separately. Could it be something else?
-Austin From: Vlad Rozov [mailto:[email protected]] Sent: Monday, December 19, 2016 6:40 PM To: [email protected] Subject: Re: Data duplication between operators This will be a bug unless the downstream operator constantly fails and is restored to a checkpoint in which case it is expected that it may get the same tuple multiple times. Thank you, Vlad On 12/19/16 11:33, Doyle, Austin O. wrote: I'm trying to send some sequential data between an S3 Input Operator and a CSV Parser operator. I added logging to see what the outputPort is emitting and it seems to be straightforward (data points 1 to 1000). I added logging on the input of the CSV Parser which receives 1000 data points but not the correct data points. It actually receives random data points multiple times (like point 57 twenty or so times). Has anyone seen anything like this? Thanks, Austin
