Re: Dropping messages based on timestamp.

2020-05-29 Thread Arvid Heise
Although flatMap() is a valid choice, it would be more idiomatic to use filter(). I'd apply that even before running TimestampAssigner, except when extracting the timestamp is rather complicated. But if it's a simple field, then it feels better to first filter bad data, and then apply any kind of

Re: Dropping messages based on timestamp.

2020-05-29 Thread Robert Metzger
Hi Joe, my gut feeling is that a flatMap() is what you are looking for. Best, Robert On Thu, May 28, 2020 at 7:21 PM Joe Malt wrote: > Hi, > > I'm working on a custom TimestampAssigner which will do different things > depending on the value of the extracted timestamp. One of the actions I >