Hello Sachit, I think that's the first question all of us ask our self when facing that moment, "Ok, but, how many partitions do we need?"
I would say, according to my experience, that directly depends on your business and the kind of problem you are trying to solve, how many consumer and producers that topic will have, and so on. I would recommend reading the blog post "How to choose the number of topics/partitions in a Kafka cluster <https://webcache.googleusercontent.com/search?q=cache:Kum1ZTnjfKUJ:https://www.confluent.io/blog/how-choose-number-topics-partitions-kafka-cluster+&cd=1&hl=en&ct=clnk&gl=uk>". Also, as a general advice, plan ahead your topic configuration and size, otherwise you could regret in the future. Last, but not least, this presentation from Gwen Shapira How much Kafka? <https://www.slideshare.net/ConfluentInc/how-much-kafka/ConfluentInc/how-much-kafka> is a good resource. Hope that helps. -- Jonathan On Sun, Nov 11, 2018 at 3:29 PM Sachit Murarka <connectsac...@gmail.com> wrote: > Hi, > > Thanks for reply. > You have shared the command. I am looking for the formula or way to > calculate the number of partitions for my topic. > > Regards, > Sachit > > On Sun, 11 Nov 2018, 20:08 花儿向阳开 <2468946...@qq.com wrote: > > > Hi, > > Maybe you can use the command like: > > kafka-topic.sh --create --topic <topic_name> --partitions > > <partition_number> --replication-factor <replica_number> --zookeeper > > <zookeeperIP:Port> > > I hope it helps! > > > > > > Regards! > > Cathy > > ------------------ 原始邮件 ------------------ > > 发件人: "Sachit Murarka"<connectsac...@gmail.com>; > > 发送时间: 2018年11月11日(星期天) 晚上10:48 > > 收件人: "users"<users@kafka.apache.org>; > > > > 主题: Deciding number of partitions > > > > > > > > Hello All, > > > > I am new to kafka. Could anyone please tell how to decided number of > > partitions for our topic? > > > > > > Kind Regards, > > Sachit Murarka > -- Santilli Jonathan
