Re: Parallelisation factor in kafka streams

2016-07-06 Thread Jeyhun Karimov
I meant restarting the underlying KAFKA on which Kafka Streams library is running. So, with restarting Streams application (and not the underlying KAFKA) one can change the number of threads within the application. On Wed, Jul 6, 2016 at 11:22 PM Matthias J. Sax wrote: > Jeyhun, > > you cannot c

Re: Parallelisation factor in kafka streams

2016-07-06 Thread Matthias J. Sax
Jeyhun, you cannot change the number of threads within an application instance, but you can start new application instances. Internal Kafka Consumer re-balance with re-assign the partitions over all running application instances. Not sure what you mean by "restart the cluster"? For sure, you do n

Re: Parallelisation factor in kafka streams

2016-07-06 Thread Jeyhun Karimov
Thank you for your answer Matthias. Is it possible to change the parallelism in runtime? Or do we have to restart the cluster? On Wed, 6 Jul 2016 at 19:08, Matthias J. Sax wrote: > Hi Jeyhun, > > the number of partitions determine the number of tasks within a Kafka > Streams application and thu

Re: Parallelisation factor in kafka streams

2016-07-06 Thread Matthias J. Sax
Hi Jeyhun, the number of partitions determine the number of tasks within a Kafka Streams application and thus, the maximum number of parallelism for your application. For more details see http://docs.confluent.io/3.0.0/streams/architecture.html#parallelism-model You can set the number of threads