Re: Fair Scheduler Pools with Kafka Streaming

2016-02-16 Thread Sebastian Piu
Yes it is related to concurrentJobs, so you need to increase that. Salt that will mean that if you get overlapping batches then those will be executed in parallel too On Tue, 16 Feb 2016, 18:33 p pathiyil wrote: > Hi, > > I am trying to use Fair Scheduler Pools with Kafka Stream

Fair Scheduler Pools with Kafka Streaming

2016-02-16 Thread p pathiyil
Hi, I am trying to use Fair Scheduler Pools with Kafka Streaming. I am assigning each Kafka partition to its own pool. The attempt is to give each partition an equal share of compute time irrespective of the number of messages in each time window for each partition. However, I do not see fair