Re: Kafka Streams, WindowBy, Grace Period, Late events, Suppres operation

2020-05-11 Thread Baki Hayat
Hello Scott, Thank you for your response, Actually i was not aware that i should window deserializer... in my code it was not asked me to add window deserializer. In which part should i provide deserializer ? I am just providing window size in my code. BR On 11 May 2020 Mon at 18:48 Scott

Re: Kafka Streams, WindowBy, Grace Period, Late events, Suppres operation

2020-05-11 Thread Baki Hayat
Hello John, Thank you for your response, I am using custom time extractor, in final stage i am persisting streamed data into timeseries database and when i did a double check from there, i confirmed that time calculation seems correct. How about warning message that i mentioned ? How can be

Re: Kafka Streams, WindowBy, Grace Period, Late events, Suppres operation

2020-05-11 Thread Scott Reynolds
Baki, You can get this message "o.a.k.s.state.internals.WindowKeySchema : Warning: window end time was truncated to Long.MAX"" when your TimeWindowDeserializer is created without a windowSize. There are two constructors for a TimeWindowDeserializer, are you using the one with WindowSize?

Re: Kafka Streams, WindowBy, Grace Period, Late events, Suppres operation

2020-05-11 Thread John Roesler
Hello Baki, It looks like option 2 is really what you want. The purpose of the time window stores is to allow deleting old data when you need to group by a time dimension, which naturally results in an infinite key space. If you don’t want to wait for the final result, can you just not add