[
https://issues.apache.org/jira/browse/BEAM-2551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raghu Angadi updated BEAM-2551:
-------------------------------
Affects Version/s: 2.0.0
Fix Version/s: 2.1.0
Description:
If the KafaIO source reader on the worker can't reach the server, Kafka
consumer blocks forever inside {{UnboundedReader.start()}}. Users have no
indication of the error. It is better if start() fails with an error.
It is easy to reproduce in Kafka. I reported it on Kafka users list here :
https://lists.apache.org/thread.html/98cebefacbd65b0d6c6817fe0b5197e26bc60252e72d05fced91e628@%3Cusers.kafka.apache.org%3E
It blocks inside Kafka client. Fortunately it can be unblocked with
KafkaConsumer.wakeup(). We could run initialization in another thread and
cancel it if takes longer than a minute.
was:
If the KafaIO source reader on the worker can't reach the server, Kafka
consumer blocks forever inside {{UnboundedReader.start()}}. Users have no
indication of the error. It is better if start() fails with an error.
It is easy to reproduce in Kafka. I reported it on Kafka users list here :
https://lists.apache.org/thread.html/98cebefacbd65b0d6c6817fe0b5197e26bc60252e72d05fced91e628@%3Cusers.kafka.apache.org%3E
It blocks inside Kafka client. Fortunately it can be unblocked with
KafkaConsumer.wakeup(). We could run initialization in another thread and
cancel it if takes longer than a minute.
> KafkaIO reader blocks indefinitely if servers are not reachable
> ---------------------------------------------------------------
>
> Key: BEAM-2551
> URL: https://issues.apache.org/jira/browse/BEAM-2551
> Project: Beam
> Issue Type: Bug
> Components: sdk-java-extensions
> Affects Versions: 2.0.0
> Reporter: Raghu Angadi
> Assignee: Raghu Angadi
> Fix For: 2.1.0
>
>
> If the KafaIO source reader on the worker can't reach the server, Kafka
> consumer blocks forever inside {{UnboundedReader.start()}}. Users have no
> indication of the error. It is better if start() fails with an error.
> It is easy to reproduce in Kafka. I reported it on Kafka users list here :
> https://lists.apache.org/thread.html/98cebefacbd65b0d6c6817fe0b5197e26bc60252e72d05fced91e628@%3Cusers.kafka.apache.org%3E
> It blocks inside Kafka client. Fortunately it can be unblocked with
> KafkaConsumer.wakeup(). We could run initialization in another thread and
> cancel it if takes longer than a minute.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
