Hi, All I am running performance test on kafka, the command
bin/kafka-run-class.sh org.apache.kafka.clients.tools.ProducerPerformance test-rep-three 50000000000 100 -1 acks=1 bootstrap.servers= 10.100.10.101:9092 buffer.memory=67108864 batch.size=8196 Since we send 50 billions to brokers, it was OK but periodically pop out such errors: [2015-01-06 19:38:32,127] WARN Error in I/O with exemplary-birds.master/ 127.0.1.1 (org.apache.kafka.common.network.Selector) java.net.ConnectException: Connection refused at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) at org.apache.kafka.common.network.Selector.poll(Selector.java:232) at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:191) at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:184) at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:115) at java.lang.Thread.run(Thread.java:745) 1950 records sent, 224.4 records/sec (0.02 MB/sec), 611.4 ms avg latency, 9259.0 max latency. 2899650 records sent, 579930.0 records/sec (55.31 MB/sec), 2399.5 ms avg latency, 9505.0 max latency. 3170219 records sent, 634043.8 records/sec (60.47 MB/sec), 568.7 ms avg latency, 1201.0 max latency. And I feel the error happen more often, our kafka cluster is a three node cluster. thanks -- Alec Li