Re: Kafka streams failed for internal topics with FailOnInvalidTimestamp even with WallclockTimestampExtracto

2018-03-23 Thread Shelan Perera
Hi Mattias, Thank you very much for the explanation it really helps. We found out that one of the brokers were using older message formats and that caused the problem. Best Regards, Shelan. On 22 March 2018 at 23:28, Matthias J. Sax wrote: > Hi, > > the

Re: Kafka streams failed for internal topics with FailOnInvalidTimestamp even with WallclockTimestampExtracto

2018-03-22 Thread Matthias J. Sax
Hi, the WallclockTimestampExtractor is only applied to source topics (this is a correctness fix included in 1.0 release: https://issues.apache.org/jira/browse/KAFKA-4785). When writing records into the repartition topics they get the timestamp for the input record (ie, whatever

Kafka streams failed for internal topics with FailOnInvalidTimestamp even with WallclockTimestampExtracto

2018-03-22 Thread Shelan Perera
Hi, We are trying to run an Kafka streams applications against a Kafka cluster and some of the incoming messages have negative timestamp as some of the producers are using older version of the Kafka. Therefore we used WallclockTimeStampExtractor to patch those timestamps. But also read in the