Re: questions

2015-05-22 Thread Carles Sistare
I am afraid you can’t, the number of partitions can be added manually, but not dynamicly in function of your partition size. On 22 May 2015, at 09:42, ram kumar ramkumarro...@gmail.com wrote: max size of partition On Fri, May 22, 2015 at 12:04 PM, Carles Sistaré

Re: Optimal number of partitions for topic

2015-05-21 Thread Carles Sistare
of messages, the order is maintained within a partitions. But if you put 100 partitions per topic on 1 single broker, I wonder if it is going to be an overhead. On Wed, May 20, 2015 at 1:02 AM, Carles Sistare car...@ogury.co wrote: Hi, We are implementing a Kafka cluster with 9 brokers

Optimal number of partitions for topic

2015-05-20 Thread Carles Sistare
Hi, We are implementing a Kafka cluster with 9 brokers into EC2 instances, and we are trying to find out the optimal number of partitions for our topics, finding out the maximal number in order not to update the partition number anymore. What we understood is that the number of partitions

Optimal number of partitions for topic

2015-05-20 Thread Carles Sistare
the cleaner will be enabled and individual logs can then be marked for log compaction. log.cleaner.enable=false # Timeout in ms for connecting to zookeeper zookeeper.connection.timeout.ms=100 auto.leader.rebalance.enable=true controlled.shutdown.enable=true Thanks in advance. Carles Sistare