[
https://issues.apache.org/jira/browse/KAFKA-2078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14693213#comment-14693213
]
PC commented on KAFKA-2078:
---------------------------
Here is an update on appears to cause this problem:
Pumping 4 messages, 1 from each of the 4 producers:
11:16:26.333 [kafka-producer-network-thread | producer-1] DEBUG producer -
PumpSuccess topic[test] partition[0] offset[582177743]
11:16:26.333 [kafka-producer-network-thread | producer-3] DEBUG producer -
PumpSuccess topic[test] partition[0] offset[582177741]
11:16:26.333 [kafka-producer-network-thread | producer-2] DEBUG producer -
PumpSuccess topic[test] partition[0] offset[582177744]
11:16:26.333 [kafka-producer-network-thread | producer-4] DEBUG producer -
PumpSuccess topic[test] partition[0] offset[582177742]
11:21:26.243 [kafka-producer-network-thread | producer-3] DEBUG
o.apache.kafka.clients.NetworkClient - Trying to send metadata request to node 0
11:21:26.243 [kafka-producer-network-thread | producer-4] DEBUG
o.apache.kafka.clients.NetworkClient - Trying to send metadata request to node 0
11:21:26.243 [kafka-producer-network-thread | producer-1] DEBUG
o.apache.kafka.clients.NetworkClient - Trying to send metadata request to node 0
11:21:26.243 [kafka-producer-network-thread | producer-2] DEBUG
o.apache.kafka.clients.NetworkClient - Trying to send metadata request to node 0
11:21:26.243 [kafka-producer-network-thread | producer-3] DEBUG
o.apache.kafka.clients.NetworkClient - Sending metadata request
ClientRequest(expectResponse=true, payload=null,
request=RequestSend(header={api_key=3,api_version=0,correlation_id=2,client_id=producer-3},
body={topics=[test]})) to node 0
11:21:26.243 [kafka-producer-network-thread | producer-4] DEBUG
o.apache.kafka.clients.NetworkClient - Sending metadata request
ClientRequest(expectResponse=true, payload=null,
request=RequestSend(header={api_key=3,api_version=0,correlation_id=2,client_id=producer-4},
body={topics=[test]})) to node 0
11:21:26.244 [kafka-producer-network-thread | producer-2] DEBUG
o.apache.kafka.clients.NetworkClient - Sending metadata request
ClientRequest(expectResponse=true, payload=null,
request=RequestSend(header={api_key=3,api_version=0,correlation_id=2,client_id=producer-2},
body={topics=[test]})) to node 0
11:21:26.244 [kafka-producer-network-thread | producer-1] DEBUG
o.apache.kafka.clients.NetworkClient - Sending metadata request
ClientRequest(expectResponse=true, payload=null,
request=RequestSend(header={api_key=3,api_version=0,correlation_id=2,client_id=producer-1},
body={topics=[test]})) to node 0
11:21:26.245 [kafka-producer-network-thread | producer-2] DEBUG
o.a.k.c.producer.internals.Metadata - Updated cluster metadata version 3 to
Cluster(nodes = [Node(0, localhost, 9092)], partitions = [Partition(topic =
test, partition = 0, leader = 0, replicas = [0,], isr = [0,]])
11:21:26.245 [kafka-producer-network-thread | producer-3] DEBUG
o.a.k.c.producer.internals.Metadata - Updated cluster metadata version 3 to
Cluster(nodes = [Node(0, localhost, 9092)], partitions = [Partition(topic =
test, partition = 0, leader = 0, replicas = [0,], isr = [0,]])
11:21:26.245 [kafka-producer-network-thread | producer-1] DEBUG
o.a.k.c.producer.internals.Metadata - Updated cluster metadata version 3 to
Cluster(nodes = [Node(0, localhost, 9092)], partitions = [Partition(topic =
test, partition = 0, leader = 0, replicas = [0,], isr = [0,]])
11:21:26.245 [kafka-producer-network-thread | producer-4] DEBUG
o.a.k.c.producer.internals.Metadata - Updated cluster metadata version 3 to
Cluster(nodes = [Node(0, localhost, 9092)], partitions = [Partition(topic =
test, partition = 0, leader = 0, replicas = [0,], isr = [0,]])
11:21:26.243 [kafka-producer-network-thread | producer-3] DEBUG
o.apache.kafka.clients.NetworkClient - Trying to send metadata request to node 0
11:21:26.243 [kafka-producer-network-thread | producer-4] DEBUG
o.apache.kafka.clients.NetworkClient - Trying to send metadata request to node 0
11:21:26.243 [kafka-producer-network-thread | producer-1] DEBUG
o.apache.kafka.clients.NetworkClient - Trying to send metadata request to node 0
11:21:26.243 [kafka-producer-network-thread | producer-2] DEBUG
o.apache.kafka.clients.NetworkClient - Trying to send metadata request to node 0
11:21:26.243 [kafka-producer-network-thread | producer-3] DEBUG
o.apache.kafka.clients.NetworkClient - Sending metadata request
ClientRequest(expectResponse=true, payload=null,
request=RequestSend(header={api_key=3,api_version=0,correlation_id=2,client_id=producer-3},
body={topics=[test]})) to node 0
11:21:26.243 [kafka-producer-network-thread | producer-4] DEBUG
o.apache.kafka.clients.NetworkClient - Sending metadata request
ClientRequest(expectResponse=true, payload=null,
request=RequestSend(header={api_key=3,api_version=0,correlation_id=2,client_id=producer-4},
body={topics=[test]})) to node 0
11:21:26.244 [kafka-producer-network-thread | producer-2] DEBUG
o.apache.kafka.clients.NetworkClient - Sending metadata request
ClientRequest(expectResponse=true, payload=null,
request=RequestSend(header={api_key=3,api_version=0,correlation_id=2,client_id=producer-2},
body={topics=[test]})) to node 0
11:21:26.244 [kafka-producer-network-thread | producer-1] DEBUG
o.apache.kafka.clients.NetworkClient - Sending metadata request
ClientRequest(expectResponse=true, payload=null,
request=RequestSend(header={api_key=3,api_version=0,correlation_id=2,client_id=producer-1},
body={topics=[test]})) to node 0
11:21:26.245 [kafka-producer-network-thread | producer-2] DEBUG
o.a.k.c.producer.internals.Metadata - Updated cluster metadata version 3 to
Cluster(nodes = [Node(0, localhost, 9092)], partitions = [Partition(topic =
test, partition = 0, leader = 0, replicas = [0,], isr = [0,]])
11:21:26.245 [kafka-producer-network-thread | producer-3] DEBUG
o.a.k.c.producer.internals.Metadata - Updated cluster metadata version 3 to
Cluster(nodes = [Node(0, localhost, 9092)], partitions = [Partition(topic =
test, partition = 0, leader = 0, replicas = [0,], isr = [0,]])
11:21:26.245 [kafka-producer-network-thread | producer-1] DEBUG
o.a.k.c.producer.internals.Metadata - Updated cluster metadata version 3 to
Cluster(nodes = [Node(0, localhost, 9092)], partitions = [Partition(topic =
test, partition = 0, leader = 0, replicas = [0,], isr = [0,]])
11:21:26.245 [kafka-producer-network-thread | producer-4] DEBUG
o.a.k.c.producer.internals.Metadata - Updated cluster metadata version 3 to
Cluster(nodes = [Node(0, localhost, 9092)], partitions = [Partition(topic =
test, partition = 0, leader = 0, replicas = [0,], isr = [0,]])
11:26:26.245 [kafka-producer-network-thread | producer-4] DEBUG
o.apache.kafka.clients.NetworkClient - Trying to send metadata request to node 0
11:26:26.245 [kafka-producer-network-thread | producer-1] DEBUG
o.apache.kafka.clients.NetworkClient - Trying to send metadata request to node 0
11:26:26.245 [kafka-producer-network-thread | producer-2] DEBUG
o.apache.kafka.clients.NetworkClient - Trying to send metadata request to node 0
11:26:26.245 [kafka-producer-network-thread | producer-3] DEBUG
o.apache.kafka.clients.NetworkClient - Trying to send metadata request to node 0
11:26:26.246 [kafka-producer-network-thread | producer-4] DEBUG
o.apache.kafka.clients.NetworkClient - Sending metadata request
ClientRequest(expectResponse=true, payload=null,
request=RequestSend(header={api_key=3,api_version=0,correlation_id=3,client_id=producer-4},
body={topics=[test]})) to node 0
11:26:26.246 [kafka-producer-network-thread | producer-1] DEBUG
o.apache.kafka.clients.NetworkClient - Sending metadata request
ClientRequest(expectResponse=true, payload=null,
request=RequestSend(header={api_key=3,api_version=0,correlation_id=3,client_id=producer-1},
body={topics=[test]})) to node 0
11:26:26.246 [kafka-producer-network-thread | producer-2] DEBUG
o.apache.kafka.clients.NetworkClient - Sending metadata request
ClientRequest(expectResponse=true, payload=null,
request=RequestSend(header={api_key=3,api_version=0,correlation_id=3,client_id=producer-2},
body={topics=[test]})) to node 0
11:26:26.246 [kafka-producer-network-thread | producer-3] DEBUG
o.apache.kafka.clients.NetworkClient - Sending metadata request
ClientRequest(expectResponse=true, payload=null,
request=RequestSend(header={api_key=3,api_version=0,correlation_id=3,client_id=producer-3},
body={topics=[test]})) to node 0
11:26:26.252 [kafka-producer-network-thread | producer-1] WARN
o.a.kafka.common.network.Selector - Error in I/O with localhost/127.0.0.1
java.io.EOFException: null
at
org.apache.kafka.common.network.NetworkReceive.readFrom(NetworkReceive.java:62)
~[kafka-clients-0.8.2.1.jar:na]
at org.apache.kafka.common.network.Selector.poll(Selector.java:248)
~[kafka-clients-0.8.2.1.jar:na]
at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:192)
[kafka-clients-0.8.2.1.jar:na]
at
org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:191)
[kafka-clients-0.8.2.1.jar:na]
at
org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:122)
[kafka-clients-0.8.2.1.jar:na]
at java.lang.Thread.run(Thread.java:745) [na:1.8.0_40]
11:26:26.252 [kafka-producer-network-thread | producer-4] WARN
o.a.kafka.common.network.Selector - Error in I/O with localhost/127.0.0.1
java.io.EOFException: null
at
org.apache.kafka.common.network.NetworkReceive.readFrom(NetworkReceive.java:62)
~[kafka-clients-0.8.2.1.jar:na]
at org.apache.kafka.common.network.Selector.poll(Selector.java:248)
~[kafka-clients-0.8.2.1.jar:na]
at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:192)
[kafka-clients-0.8.2.1.jar:na]
at
org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:191)
[kafka-clients-0.8.2.1.jar:na]
at
org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:122)
[kafka-clients-0.8.2.1.jar:na]
at java.lang.Thread.run(Thread.java:745) [na:1.8.0_40]
11:26:26.252 [kafka-producer-network-thread | producer-2] WARN
o.a.kafka.common.network.Selector - Error in I/O with localhost/127.0.0.1
java.io.EOFException: null
at
org.apache.kafka.common.network.NetworkReceive.readFrom(NetworkReceive.java:62)
~[kafka-clients-0.8.2.1.jar:na]
at org.apache.kafka.common.network.Selector.poll(Selector.java:248)
~[kafka-clients-0.8.2.1.jar:na]
at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:192)
[kafka-clients-0.8.2.1.jar:na]
at
org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:191)
[kafka-clients-0.8.2.1.jar:na]
at
org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:122)
[kafka-clients-0.8.2.1.jar:na]
at java.lang.Thread.run(Thread.java:745) [na:1.8.0_40]
11:26:26.252 [kafka-producer-network-thread | producer-3] WARN
o.a.kafka.common.network.Selector - Error in I/O with localhost/127.0.0.1
java.io.EOFException: null
at
org.apache.kafka.common.network.NetworkReceive.readFrom(NetworkReceive.java:62)
~[kafka-clients-0.8.2.1.jar:na]
at org.apache.kafka.common.network.Selector.poll(Selector.java:248)
~[kafka-clients-0.8.2.1.jar:na]
at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:192)
[kafka-clients-0.8.2.1.jar:na]
at
org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:191)
[kafka-clients-0.8.2.1.jar:na]
at
org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:122)
[kafka-clients-0.8.2.1.jar:na]
at java.lang.Thread.run(Thread.java:745) [na:1.8.0_40]
11:26:26.253 [kafka-producer-network-thread | producer-1] DEBUG
o.apache.kafka.clients.NetworkClient - Node -1 disconnected.
11:26:26.253 [kafka-producer-network-thread | producer-3] DEBUG
o.apache.kafka.clients.NetworkClient - Node -1 disconnected.
11:26:26.253 [kafka-producer-network-thread | producer-2] DEBUG
o.apache.kafka.clients.NetworkClient - Node -1 disconnected.
11:26:26.254 [kafka-producer-network-thread | producer-4] DEBUG
o.a.k.c.producer.internals.Metadata - Updated cluster metadata version 4 to
Cluster(nodes = [Node(0, localhost, 9092)], partitions = [Partition(topic =
test, partition = 0, leader = 0, replicas = [0,], isr = [0,]])
11:26:26.254 [kafka-producer-network-thread | producer-4] DEBUG
o.apache.kafka.clients.NetworkClient - Node -1 disconnected.
11:26:26.254 [kafka-producer-network-thread | producer-2] DEBUG
o.a.k.c.producer.internals.Metadata - Updated cluster metadata version 4 to
Cluster(nodes = [Node(0, localhost, 9092)], partitions = [Partition(topic =
test, partition = 0, leader = 0, replicas = [0,], isr = [0,]])
11:26:26.255 [kafka-producer-network-thread | producer-3] DEBUG
o.a.k.c.producer.internals.Metadata - Updated cluster metadata version 4 to
Cluster(nodes = [Node(0, localhost, 9092)], partitions = [Partition(topic =
test, partition = 0, leader = 0, replicas = [0,], isr = [0,]])
11:26:26.255 [kafka-producer-network-thread | producer-1] DEBUG
o.a.k.c.producer.internals.Metadata - Updated cluster metadata version 4 to
Cluster(nodes = [Node(0, localhost, 9092)], partitions = [Partition(topic =
test, partition = 0, leader = 0, replicas = [0,], isr = [0,]])
11:26:26.347 [kafka-producer-network-thread | producer-4] DEBUG
o.apache.kafka.clients.NetworkClient - Trying to send metadata request to node 0
11:26:26.348 [kafka-producer-network-thread | producer-4] DEBUG
o.apache.kafka.clients.NetworkClient - Sending metadata request
ClientRequest(expectResponse=true, payload=null,
request=RequestSend(header={api_key=3,api_version=0,correlation_id=4,client_id=producer-4},
body={topics=[test]})) to node 0
11:26:26.349 [kafka-producer-network-thread | producer-4] DEBUG
o.a.k.c.producer.internals.Metadata - Updated cluster metadata version 5 to
Cluster(nodes = [Node(0, localhost, 9092)], partitions = [Partition(topic =
test, partition = 0, leader = 0, replicas = [0,], isr = [0,]])
Perhaps this helps pin-point the real cause of the problem. Please advice.
> Getting Selector [WARN] Error in I/O with host java.io.EOFException
> -------------------------------------------------------------------
>
> Key: KAFKA-2078
> URL: https://issues.apache.org/jira/browse/KAFKA-2078
> Project: Kafka
> Issue Type: Bug
> Components: producer
> Affects Versions: 0.8.2.0
> Environment: OS Version: 2.6.39-400.209.1.el5uek and Hardware: 8 x
> Intel(R) Xeon(R) CPU X5660 @ 2.80GHz/44GB
> Reporter: Aravind
> Assignee: Jun Rao
>
> When trying to Produce 1000 (10 MB) messages, getting this below error some
> where between 997 to 1000th message. There is no pattern but able to
> reproduce.
> [PDT] 2015-03-31 13:53:50 Selector [WARN] Error in I/O with "our host"
> java.io.EOFException at
> org.apache.kafka.common.network.NetworkReceive.readFrom(NetworkReceive.java:62)
> at org.apache.kafka.common.network.Selector.poll(Selector.java:248) at
> org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:192) at
> org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:191) at
> org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:122) at
> java.lang.Thread.run(Thread.java:724)
> This error I am getting some times @ 997th message or 999th message. There is
> no pattern but able to reproduce.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
