Re: getting "original" ingestion timestamp after using a TimestampAssigner

2022-02-16 Thread Piotr Nowojski
Hi Frank, I'm not sure exactly what you are trying to accomplish, but yes. In the TimestampAssigner you can only return what should be the new timestamp for the given record. If you want to use "ingestion time" - "true even time" as some kind of delay metric, you will indeed need to have both

getting "original" ingestion timestamp after using a TimestampAssigner

2022-02-16 Thread Frank Dekervel
Hello, I'm getting messages from a kafka stream. The messages are JSON records with a "timestamp" key in the json. This timestamp key contains the time at which the message was generated. Now i'd like if these messages had a delivery delay (eg delay between message generation and arrival in