[
https://issues.apache.org/jira/browse/KAFKA-4610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15817473#comment-15817473
]
Ewen Cheslack-Postava commented on KAFKA-4610:
----------------------------------------------
The current timeout for such requests defaults to 30s. If nothing else is going
wrong, then this seems to suggest the broker is taking longer than that to
restart or is failing for longer than that for some reason.
The repeated errors trying to request metadata from a specific broker suggests
that, despite possibly having multiple bootstrap brokers, you may be hitting
https://issues.apache.org/jira/browse/KAFKA-1843 I think in your case you may
be hitting a case where the client repeated tries to use the broker that is
currently offline and therefore repeatedly times out.
Unfortunately, I don't have a quick solution for this -- we'd need to
concretely track down the root cause and then address it.
> getting error:Batch containing 3 record(s) expired due to timeout while
> requesting metadata from brokers for test2R2P2-1
> ------------------------------------------------------------------------------------------------------------------------
>
> Key: KAFKA-4610
> URL: https://issues.apache.org/jira/browse/KAFKA-4610
> Project: Kafka
> Issue Type: Bug
> Environment: Dev
> Reporter: sandeep kumar singh
>
> i a getting below error when running producer client, which take messages
> from an input file kafka_message.log. this log file is pilled with 100000
> records per second of each message of length 4096
> error -
> [2017-01-09 14:45:24,813] ERROR Error when sending message to topic test2R2P2
> with key: null, value: 4096 bytes with error:
> (org.apache.kafka.clients.producer.internals.ErrorLoggingCallback)
> org.apache.kafka.common.errors.TimeoutException: Batch containing 3 record(s)
> expired due to timeout while requesting metadata from brokers for test2R2P2-0
> [2017-01-09 14:45:24,816] ERROR Error when sending message to topic test2R2P2
> with key: null, value: 4096 bytes with error:
> (org.apache.kafka.clients.producer.internals.ErrorLoggingCallback)
> org.apache.kafka.common.errors.TimeoutException: Batch containing 3 record(s)
> expired due to timeout while requesting metadata from brokers for test2R2P2-0
> [2017-01-09 14:45:24,816] ERROR Error when sending message to topic test2R2P2
> with key: null, value: 4096 bytes with error:
> (org.apache.kafka.clients.producer.internals.ErrorLoggingCallback)
> org.apache.kafka.common.errors.TimeoutException: Batch containing 3 record(s)
> expired due to timeout while requesting metadata from brokers for test2R2P2-0
> [2017-01-09 14:45:24,816] ERROR Error when sending message to topic test2R2P2
> with key: null, value: 4096 bytes with error:
> (org.apache.kafka.clients.producer.internals.ErrorLoggingCallback)
> org.apache.kafka.common.errors.TimeoutException: Batch containing 3 record(s)
> expired due to timeout while requesting metadata from brokers for test2R2P2-0
> [2017-01-09 14:45:24,816] ERROR Error when sending message to topic test2R2P2
> with key: null, value: 4096 bytes with error:
> (org.apache.kafka.clients.producer.internals.ErrorLoggingCallback)
> org.apache.kafka.common.errors.TimeoutException: Batch containing 3 record(s)
> expired due to timeout while requesting metadata from brokers for test2R2P2-0
> command i run :
> $ bin/kafka-console-producer.sh --broker-list x.x.x.x:xxxx,x.x.x.x:xxxx
> --batch-size 1000 --message-send-max-retries 10 --request-required-acks 1
> --topic test2R2P2 <~/kafka_message.log
> there are 2 brokers running and the topic has partitions = 2 and replication
> factor 2.
> Could you please help me understand what does that error means?
> also i see message loss when i manually restart one of the broker and while
> kafak-producer-perf-test command is running? is this a expected behavior?
> thanks
> Sandeep
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
