Re: NotLeaderForPartitionException while doing performance test

2015-01-08 Thread Sa Li
Thanks, Jaikiran I was trying to duplicate the same issue by running the same performance test on master node of cluster , say exemplary-birds.master, and I did see such error again org.apache.kafka.common.errors.NotLeaderForPartitionException: This server is not the leader for that

Re: NotLeaderForPartitionException while doing performance test

2015-01-07 Thread Sa Li
Yes, it is weird hostname, ;), that is what our system guys name it. How to take a note to measure the connections open to 10.100.98.102? Thanks AL On Jan 7, 2015 9:42 PM, Jaikiran Pai jai.forums2...@gmail.com wrote: On Thursday 08 January 2015 01:51 AM, Sa Li wrote: see this type of error

Re: NotLeaderForPartitionException while doing performance test

2015-01-07 Thread Jaikiran Pai
On Thursday 08 January 2015 01:51 AM, Sa Li wrote: see this type of error again, back to normal in few secs [2015-01-07 20:19:49,744] WARN Error in I/O with harmful-jar.master/ 10.100.98.102 That's a really weird hostname, the harmful-jar.master. Is that really your hostname? You mention

Re: NotLeaderForPartitionException while doing performance test

2015-01-07 Thread Jaikiran Pai
There are different ways to find the connection count and each one depends on the operating system that's being used. lsof -i is one option, for example, on *nix systems. -Jaikiran On Thursday 08 January 2015 11:40 AM, Sa Li wrote: Yes, it is weird hostname, ;), that is what our system guys

NotLeaderForPartitionException while doing performance test

2015-01-07 Thread Sa Li
Hi, All I am doing performance test by bin/kafka-run-class.sh org.apache.kafka.clients.tools.ProducerPerformance test-rep-three 5 100 -1 acks=1 bootstrap.servers=10.100.98.100:9092, 10.100.98.101:9092,10.100.98.102:9092 buffer.memory=67108864 batch.size=8196 where the topic

Re: NotLeaderForPartitionException while doing performance test

2015-01-07 Thread Sa Li
see this type of error again, back to normal in few secs [2015-01-07 20:19:49,744] WARN Error in I/O with harmful-jar.master/ 10.100.98.102 (org.apache.kafka.common.network.Selector) java.net.ConnectException: Connection refused at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)

Re: NotLeaderForPartitionException while doing performance test

2015-01-07 Thread Sa Li
I checked topic config, isr changes dynamically. root@voluminous-mass:/srv/kafka# bin/kafka-topics.sh --describe --zookeeper 10.100.98.101:2181 --topic test-rep-three Topic:test-rep-threePartitionCount:8ReplicationFactor:3 Configs: Topic: test-rep-three Partition: 0