[
https://issues.apache.org/jira/browse/KAFKA-3145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15147932#comment-15147932
]
Dong Lin commented on KAFKA-3145:
---------------------------------
[~zhiwei], yeah I understand that CPU usage depends the performance of the
machine. But I couldn't reproduce the NullPointerException using the latest
trunk.
I used kafka with git hash d7fc7cf6154592b7fea494a092e42ad9d45b98a0 without
chaning any file. The zookeeper, broker and producer are started as shown below:
zookeeper-server-start.sh config/zookeeper.properties
kafka-server-start.sh config/server.properties
kafka-producer-perf-test.sh --topic test --num-records 1000000 --record-size
100 --throughput 100000 --producer-props bootstrap.servers=localhost:9095.
If you are able to reproduce the NullPointerException, can you tell me the
following information:
- the git hash value of kafka you used
- The commands you used to start producer and broker.
Thanks,
> CPU Usage Spike to 100% when network connection is to error port
> ----------------------------------------------------------------
>
> Key: KAFKA-3145
> URL: https://issues.apache.org/jira/browse/KAFKA-3145
> Project: Kafka
> Issue Type: Bug
> Components: producer
> Affects Versions: 0.8.2.1, 0.9.0.0
> Reporter: zhiwei
> Assignee: Dong Lin
> Fix For: 0.9.1.0
>
>
> CPU spike to 100% when network connection is to error port.
> It seems network IO thread are very busy logging following error message.
> [2016-01-25 14:09:12,476] ERROR Uncaught error in kafka producer I/O thread:
> (org.apache.kafka.clients.producer.internals.Sender)
> java.lang.IllegalStateException: Invalid request (size = -1241382912)
> at
> org.apache.kafka.common.network.NetworkReceive.readFrom(NetworkReceive.java:68)
> at org.apache.kafka.common.network.Selector.poll(Selector.java:248)
> at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:192)
> at
> org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:191)
> at
> org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:122)
> at java.lang.Thread.run(Thread.java:745)
> [2016-01-25 14:09:12,479] ERROR Uncaught error in kafka producer I/O thread:
> (org.apache.kafka.clients.producer.internals.Sender)
> java.lang.NullPointerException
> at
> org.apache.kafka.common.network.NetworkReceive.complete(NetworkReceive.java:48)
> at org.apache.kafka.common.network.Selector.poll(Selector.java:249)
> at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:192)
> at
> org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:191)
> at
> org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:122)
> at java.lang.Thread.run(Thread.java:745)
> [2016-01-25 14:09:12,480] ERROR Uncaught error in kafka producer I/O thread:
> (org.apache.kafka.clients.producer.internals.Sender)
> java.lang.NullPointerException
> at
> org.apache.kafka.common.network.NetworkReceive.complete(NetworkReceive.java:48)
> at org.apache.kafka.common.network.Selector.poll(Selector.java:249)
> at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:192)
> at
> org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:191)
> at
> org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:122)
> at java.lang.Thread.run(Thread.java:745)
> [2016-01-25 14:09:12,480] ERROR Uncaught error in kafka producer I/O thread:
> (org.apache.kafka.clients.producer.internals.Sender)
> java.lang.NullPointerException
> at
> org.apache.kafka.common.network.NetworkReceive.complete(NetworkReceive.java:48)
> at org.apache.kafka.common.network.Selector.poll(Selector.java:249)
> at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:192)
> at
> org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:191)
> at
> org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:122)
> at java.lang.Thread.run(Thread.java:745)
> [2016-01-25 14:09:12,481] ERROR Uncaught error in kafka producer I/O thread:
> (org.apache.kafka.clients.producer.internals.Sender)
> java.lang.NullPointerException
> at
> org.apache.kafka.common.network.NetworkReceive.complete(NetworkReceive.java:48)
> at org.apache.kafka.common.network.Selector.poll(Selector.java:249)
> at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:192)
> at
> org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:191)
> at
> org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:122)
> at java.lang.Thread.run(Thread.java:745)
> Thanks,
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)