Luke Chen created KAFKA-16283:
---------------------------------
Summary: RoundRobinPartitioner will only send to half of the
partitions in a topic
Key: KAFKA-16283
URL: https://issues.apache.org/jira/browse/KAFKA-16283
Project: Kafka
Issue Type: Bug
Reporter: Luke Chen
When using `org.apache.kafka.clients.producer.RoundRobinPartitioner`, we expect
data are send to all partitions in round-robin manner. But we found there are
only half of the partitions got the data. This causes half of the
resources(storage, consumer...) are wasted.
{code:java}
bin/kafka-topics.sh --create --topic quickstart-events4 --bootstrap-server
localhost:9092 --partitions 2
Created topic quickstart-events4.
bin/kafka-producer-perf-test.sh --topic quickstart-events4 --num-records 10
--record-size 100 --throughput -1 --producer-props
bootstrap.servers=localhost:9092
partitioner.class=org.apache.kafka.clients.producer.RoundRobinPartitioner
10 records sent, 72.463768 records/sec (0.01 MB/sec), 35.10 ms avg latency,
132.00 ms max latency, 24 ms 50th, 132 ms 95th, 132 ms 99th, 132 ms 99.9th.
lukchen@lukchen-mac kafka % ls -al /tmp/kafka-logs/quickstart-events4-0
total 24
drwxr-xr-x 7 lukchen wheel 224 2 20 19:53 .
drwxr-xr-x 70 lukchen wheel 2240 2 20 19:53 ..
-rw-r--r-- 1 lukchen wheel 10485760 2 20 19:53 00000000000000000000.index
-rw-r--r-- 1 lukchen wheel 1151 2 20 19:53 00000000000000000000.log
-rw-r--r-- 1 lukchen wheel 10485756 2 20 19:53
00000000000000000000.timeindex
-rw-r--r-- 1 lukchen wheel 8 2 20 19:53 leader-epoch-checkpoint
-rw-r--r-- 1 lukchen wheel 43 2 20 19:53 partition.metadata
lukchen@lukchen-mac kafka % ls -al /tmp/kafka-logs/quickstart-events4-1
total 8
drwxr-xr-x 7 lukchen wheel 224 2 20 19:53 .
drwxr-xr-x 70 lukchen wheel 2240 2 20 19:53 ..
-rw-r--r-- 1 lukchen wheel 10485760 2 20 19:53 00000000000000000000.index
-rw-r--r-- 1 lukchen wheel 0 2 20 19:53 00000000000000000000.log
-rw-r--r-- 1 lukchen wheel 10485756 2 20 19:53
00000000000000000000.timeindex
-rw-r--r-- 1 lukchen wheel 0 2 20 19:53 leader-epoch-checkpoint
-rw-r--r-- 1 lukchen wheel 43 2 20 19:53 partition.metadata
{code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
