Re: KStreams State Store - state.dir does not have .checkpoint file

2022-06-01 Thread Steven Schlansker
> On Jun 1, 2022, at 5:27 AM, Neeraj Vaidya > wrote: > > Thanks John ! > It seems if I send a TERM signal to my KStreams application which is running > inside a Docker container, then it results in a Clean shutdown. > This also then creates a checkpoint file successfully. > So, I guess I

Re: KStreams State Store - state.dir does not have .checkpoint file

2022-06-01 Thread Neeraj Vaidya
Thanks John ! It seems if I send a TERM signal to my KStreams application which is running inside a Docker container, then it results in a Clean shutdown. This also then creates a checkpoint file successfully. So, I guess I need to figure out how to send a TERM signal to my running Java

Re: KStreams State Store - state.dir does not have .checkpoint file

2022-06-01 Thread John Roesler
Hi Neeraj, Thanks for all that detail! Your expectation is correct. You should see the checkpoint files after a _clean_ shutdown, and then you should not see it bootstrap from the beginning of the changelog on the next startup. How are you shutting down the application? You'll want to call

KStreams State Store - state.dir does not have .checkpoint file

2022-05-31 Thread Neeraj Vaidya
Hi All, I have a KStreams application running inside a Docker container which uses a persistent key-value store. I have configured state.dir with a value of /tmp/kafka-streams (which is the default). When I start this container using "docker run", I mount /tmp/kafka-streams to a directory on