sandeep kumar singh created KAFKA-4610:
------------------------------------------
Summary: getting error:Batch containing 3 record(s) expired due to
timeout while requesting metadata from brokers for test2R2P2-1
Key: KAFKA-4610
URL: https://issues.apache.org/jira/browse/KAFKA-4610
Project: Kafka
Issue Type: Bug
Environment: Dev
Reporter: sandeep kumar singh
Fix For: 0.10.2.0
i a getting below error when running producer client, which take messages from
an input file kafka_message.log. this log file is pilled with 100000 records
per second of each message of length 4096
error -
[2017-01-09 14:45:24,813] ERROR Error when sending message to topic test2R2P2
with key: null, value: 4096 bytes with error:
(org.apache.kafka.clients.producer.internals.ErrorLoggingCallback)
org.apache.kafka.common.errors.TimeoutException: Batch containing 3 record(s)
expired due to timeout while requesting metadata from brokers for test2R2P2-0
[2017-01-09 14:45:24,816] ERROR Error when sending message to topic test2R2P2
with key: null, value: 4096 bytes with error:
(org.apache.kafka.clients.producer.internals.ErrorLoggingCallback)
org.apache.kafka.common.errors.TimeoutException: Batch containing 3 record(s)
expired due to timeout while requesting metadata from brokers for test2R2P2-0
[2017-01-09 14:45:24,816] ERROR Error when sending message to topic test2R2P2
with key: null, value: 4096 bytes with error:
(org.apache.kafka.clients.producer.internals.ErrorLoggingCallback)
org.apache.kafka.common.errors.TimeoutException: Batch containing 3 record(s)
expired due to timeout while requesting metadata from brokers for test2R2P2-0
[2017-01-09 14:45:24,816] ERROR Error when sending message to topic test2R2P2
with key: null, value: 4096 bytes with error:
(org.apache.kafka.clients.producer.internals.ErrorLoggingCallback)
org.apache.kafka.common.errors.TimeoutException: Batch containing 3 record(s)
expired due to timeout while requesting metadata from brokers for test2R2P2-0
[2017-01-09 14:45:24,816] ERROR Error when sending message to topic test2R2P2
with key: null, value: 4096 bytes with error:
(org.apache.kafka.clients.producer.internals.ErrorLoggingCallback)
org.apache.kafka.common.errors.TimeoutException: Batch containing 3 record(s)
expired due to timeout while requesting metadata from brokers for test2R2P2-0
command i run :
$ bin/kafka-console-producer.sh --broker-list x.x.x.x:xxxx,x.x.x.x:xxxx
--batch-size 1000 --message-send-max-retries 10 --request-required-acks 1
--topic test2R2P2 <~/kafka_message.log
there are 2 brokers running and the topic has partitions = 2 and replication
factor 2.
Could you please help me understand what does that error means?
also i see message loss when i manually restart one of the broker and while
kafak-producer-perf-test command is running? is this a expected behavior?
thanks
Sandeep
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
