Raghu Angadi created BEAM-5375:
----------------------------------
Summary: KafkaIO reader should handle runtime exceptions kafka
client
Key: BEAM-5375
URL: https://issues.apache.org/jira/browse/BEAM-5375
Project: Beam
Issue Type: Bug
Components: io-java-kafka
Affects Versions: 2.7.0
Reporter: Raghu Angadi
Assignee: Raghu Angadi
KafkaIO reader might stop reading from Kafka without any explicit error message
if KafkaConsumer throws a runtime exception while polling for messages. One of
the Dataflow customers encountered this issue (see [user@
thread|[https://lists.apache.org/thread.html/c0cf8f45f567a0623592e2d8340f5288e3e774b59bca985aec410a81@%3Cuser.beam.apache.org%3E])]
'consumerPollThread()' in KafkaIO deliberately avoided catching runtime
exceptions. It shoud handle it.. stuff happens at runtime.
It should result in 'IOException' from start()/advance(). The runners will
handle properly reporting and closing the readers.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
