Re: changelog topic with in-memory state store

2017-01-12 Thread Daisuke Moriya
Thanks for your response Damian. > However the in-memory store will write each update to the changelog > (regardless of context.commit), which seems to be the issue you have? Yes. I have the issue. Although I can't say a specific number, it is issue for me, for example, that Kafka Streams reads h

Re: changelog topic with in-memory state store

2017-01-11 Thread Damian Guy
Hi, There is no way to enable caching on in-memory-store - by definition it is already cached. However the in-memory store will write each update to the changelog (regardless of context.commit), which seems to be the issue you have? When you say large, how large? Have you tested it and observed t

changelog topic with in-memory state store

2017-01-10 Thread Daisuke Moriya
Hi. I am developing a simple log counting application using Kafka Streams 0.10.1.1. Its implementation is almost the same as the WordCountProcessor in the confluent document [http://docs.confluent.io/3.1.1/streams/developer-guide.html#processor-api]. I am using in-memory state store, its key is