Sendoh created FLINK-5368:
-----------------------------
Summary: Let Kafka consumer show something when it fails to read
one topic out of topic list
Key: FLINK-5368
URL: https://issues.apache.org/jira/browse/FLINK-5368
Project: Flink
Issue Type: Improvement
Components: Kafka Connector
Reporter: Sendoh
Assignee: Sendoh
Priority: Minor
As a developer when reading data from many topics, I want Kafka consumer to
throw Exception or LOG.error() if any topic is not available. The motivation is
we read many topics as list at one time, and sometimes we fail to recognize
that one or two topics' names have been changed or deprecated, and Flink Kafka
connector doesn't show the error.
My proposed change would be either to throw RunTimeError or to use
log.Error(topic + "doesn't have any partition") if partitionsForTopic is null
at this function.
https://github.com/apache/flink/blob/master/flink-connectors/flink-connector-kafka-0.9/src/main/java/org/apache/flink/streaming/connectors/kafka/FlinkKafkaConsumer09.java#L208
Any suggestion is welcome.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
