This might help: https://kafka.apache.org/documentation/#compaction
On Wed, 26 Jul 2017 at 12:37 Sameer Kumar wrote:
> Damian,
>
> Does this mean data is retained for infinite time limited only by disk
> space.
>
> -Sameer.
>
> On Wed, Jul 26, 2017 at 3:53 PM, Sameer Kumar
> wrote:
>
> > got it
Damian,
Does this mean data is retained for infinite time limited only by disk
space.
-Sameer.
On Wed, Jul 26, 2017 at 3:53 PM, Sameer Kumar
wrote:
> got it. Thanks.
>
> On Wed, Jul 26, 2017 at 3:24 PM, Damian Guy wrote:
>
>> The changelog is one created by kafka streams, then it is a compact
got it. Thanks.
On Wed, Jul 26, 2017 at 3:24 PM, Damian Guy wrote:
> The changelog is one created by kafka streams, then it is a compacted topic
> and the retention period is irrelevant. If it is one you have created
> yourself and isn't compacted, then the data will be retained in the topic
> f
The changelog is one created by kafka streams, then it is a compacted topic
and the retention period is irrelevant. If it is one you have created
yourself and isn't compacted, then the data will be retained in the topic
for as long as the retention period.
If you use a non-compacted topic and the k
ok. Thanks.
Actually, I had this confusion. Changelog like every Kafka topic would have
its retention period, lets say 2 days. and if the value on day1 for key1 =
4 and data for key1 doesnt come for next 3 days. Would it still retail the
same value(key1=4) on day4.
-Sameer.
On Wed, Jul 26, 2017
Sameer,
For a KeyValue store the changelog topic is a compacted topic so there is
no retention period. You will always retain the latest value for a key.
Thanks,
Damian
On Wed, 26 Jul 2017 at 08:36 Sameer Kumar wrote:
> Hi,
>
> Retention period for state stores are clear(default, otherwise spe
Hi,
Retention period for state stores are clear(default, otherwise specified by
TimeWindows.until). Intrigued to know the retention period for key values.
The use case is something like I am reading from a windowed store, and
using plain reduce() with out any time windows. Would the values be
ret
