Raghu Angadi created BEAM-2551:
----------------------------------

             Summary: KafkaIO reader blocks indefinitely if servers are not 
reachable
                 Key: BEAM-2551
                 URL: https://issues.apache.org/jira/browse/BEAM-2551
             Project: Beam
          Issue Type: Bug
          Components: sdk-java-extensions
            Reporter: Raghu Angadi
            Assignee: Raghu Angadi



If the KafaIO source reader on the worker can't reach the server, Kafka 
consumer blocks forever inside {{UnboundedReader.start()}}. Users have no 
indication of the error. It is better if start() fails with an error. 

It is easy to reproduce in Kafka. I reported it on Kafka users list here : 
https://lists.apache.org/thread.html/98cebefacbd65b0d6c6817fe0b5197e26bc60252e72d05fced91e628@%3Cusers.kafka.apache.org%3E

It blocks inside Kafka client. Fortunately it can be unblocked with 
KafkaConsumer.wakeup(). We could run initialization in another thread and 
cancel it if takes longer than a minute.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Reply via email to