Re: Scaling up kafka consumer applications(kafka streams)

You might need to pipe the data through a topic with 10 partitions using an explicit call to `.through()` -Matthias On 4/11/18 12:48 AM, Shivam Sharma wrote: > No I am not repartitioning data later. But I wanted to run 10 applications. > Is there any way to do this? > > On Mon, Apr 9, 2018 at

Re: Scaling up kafka consumer applications(kafka streams)

No I am not repartitioning data later. But I wanted to run 10 applications. Is there any way to do this? On Mon, Apr 9, 2018 at 1:44 AM, Matthias J. Sax wrote: > It depend on the concrete program you write... Most likely it's 4, but > hard to say without more information.

Re: Scaling up kafka consumer applications(kafka streams)

It depend on the concrete program you write... Most likely it's 4, but hard to say without more information. If you read all 4 topics as a single stream (i.e. pattern subscription) it should be 4. If you repartitions data in your applications later, it might be more thought. -Matthias On