Hi,

We're using Samza with Kafka and we would like to use multiple partitions
in our topics.

We've noticed that the number of partitions is defined in server.properties.
According to the Kafka documentation
<http://kafka.apache.org/07/configuration.html>, there are 2 options to
defined the number of partitions:

   - num.partitions - Specifies the default number of partitions per topic.
   - topic.partition.count.map - Override parameter to control the number
   of partitions for selected topics. E.g., topic1:10,topic2:20

We thought about using the first option (num.partitions) in order to avoid
the overhead of adding every new topic to a map. Our concern is how it
affects the metrics and checkpoint topics.

Can anyone share what is the best practice for using multiple partitions in
Kafka?


Thanks,
Dotan

Reply via email to