Re: Correct way to increase replication factor for kafka-streams internal topics

2017-10-05 Thread Dmitriy Vsekhvalnov
Thanks Matthias ! On Thu, Oct 5, 2017 at 12:16 AM, Matthias J. Sax wrote: > That is hard to do... > > Just deleting the topic might result in data loss, if not all data was > processed by the application yet (note, that repartitioning topics are > also kind of a buffer between subtopologies). >

Re: Correct way to increase replication factor for kafka-streams internal topics

2017-10-04 Thread Matthias J. Sax
That is hard to do... Just deleting the topic might result in data loss, if not all data was processed by the application yet (note, that repartitioning topics are also kind of a buffer between subtopologies). Just manually changing the number of partitions via kafka-topics.sh will break partitio

Correct way to increase replication factor for kafka-streams internal topics

2017-10-04 Thread Dmitriy Vsekhvalnov
Hi all, What is correct way to increase RF for existing internal topics that kafka-streams create (re-partitioning streams)? We are increasing RF for source topics and would like to align kafka-streams as well. App part configuration is simple, but what to do with existing internal topics? Remov