Re: Kafka streams state directory - help

2018-05-03 Thread Matthias J. Sax
Kafka Streams itself is backward compatible to 0.10.2.1 brokers. However, the embedded cluster you are using is not part of public API and the 0.10.2.1 embedded cluster might have a different API than the 1.1 embedded cluster. Thus, you would need to rewrite your tests. -Matthias On 4/21/18

Re: Kafka streams state directory - help

2018-04-21 Thread pradeep s
Thanks Matthias. Can you also please confirm the compatible versions of the client dependencies . Our broker version is 10.2.1 and when i updgrade the client library to 1.1.0, i am getting a issue with tests while starting the embedded cluster . Test dependencies are (kafka-stream.version is

Re: Kafka streams state directory - help

2018-04-21 Thread Matthias J. Sax
You are hitting: https://issues.apache.org/jira/browse/KAFKA-6499 Was fixed in 1.1 release. Thus, you can just ignore the checkpoint file. There should be no issue with running on Kubernetes. Also, if there is no store (independent of disk based or in-memory) there will be no changelog topic.

Kafka streams state directory - help

2018-04-21 Thread pradeep s
Hi, I am using kafka streams app connecting to confluent kafka cluster(10.2.1). Application is reading messages from a topic, performing a tranformation and pushing to output topic . There is no count or aggregation performed . Have following clarifications regarding state directory. *1)* Will