[
https://issues.apache.org/jira/browse/KAFKA-4739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15854943#comment-15854943
]
Vipul Singh edited comment on KAFKA-4739 at 2/6/17 11:43 PM:
-------------------------------------------------------------
consumer config:
https://gist.github.com/neoeahit/c1d4027b975b95267e3cbe506899aef8
We have request_timeout_ms = 300001 on the broker side.
So the "Cancelled FETCH request", during the reconnect backoff is expected, i
guess.
We looked on the broker server.log, and did not find anything for this consumer
during the time this issue was happening.
We added debug level logging and were able to see the heartbeat requests on
kafka-request.log. But nothing else. The brokers seem to be healthy, we are not
seeing this issue with other consumers. The only thing special about this
consumer is that it uses KafkaConsumer with these configs. The other consumers
use python to consume.
Do you have any pointers, what might some of the troubleshooting steps we can
do to investigate this further.
was (Author: neoeahit):
consumer config:
https://gist.github.com/neoeahit/c1d4027b975b95267e3cbe506899aef8
We have request_timeout_ms = 300001 on the broker side.
So the "Cancelled FETCH request", during the reconnect backoff is expected, i
guess.
We looked on the broker server.log, and did not find anything for this consumer
during the time this issue was happening.
We added debug level logging and were able to see the heartbeat requests on
kafka-request.log. But nothing else. The brokers seem to be healthy, we are not
seeing this issue with other consumers. The only thing special about this
consumer is that it uses KafkaConsumer with these configs. The other consumers
use python to consume.
> KafkaConsumer poll going into an infinite loop
> ----------------------------------------------
>
> Key: KAFKA-4739
> URL: https://issues.apache.org/jira/browse/KAFKA-4739
> Project: Kafka
> Issue Type: Bug
> Components: consumer
> Affects Versions: 0.9.0.1
> Reporter: Vipul Singh
>
> We are seeing an issue with our kafka consumer where it seems to go into an
> infinite loop while polling, trying to fetch data from kafka. We are seeing
> the heartbeat requests on the broker from the consumer, but nothing else from
> the kafka consumer.
> We enabled debug level logging on the consumer, and see these logs:
> https://gist.github.com/neoeahit/757bff7acdea62656f065f4dcb8974b4
> And this just goes on. The way we have been able to replicate this issue, is
> by restarting the process in multiple successions.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
