Re: 答复: which Kafka StateStore could I use ?

2018-03-02 Thread Ted Yu
Jie: Which DB are you using ? 600 records/second is very low rate. Probably your DB needs some tuning. Cheers On Fri, Mar 2, 2018 at 9:32 AM, Guozhang Wang wrote: > Hello Jie, > > By default Kafka Streams uses caching on top of its internal state stores > to de-dup output

Re: 答复: which Kafka StateStore could I use ?

2018-03-02 Thread Guozhang Wang
Hello Jie, By default Kafka Streams uses caching on top of its internal state stores to de-dup output streams to the final destination (in your case the DB) so that for a single key, fewer updates will be generated giving a small working set. If your aggregation logic follows such key