Brad Davis created FLINK-24409:
----------------------------------
Summary: Kafka topics with periods in their names generate a
constant stream of errors
Key: FLINK-24409
URL: https://issues.apache.org/jira/browse/FLINK-24409
Project: Flink
Issue Type: Improvement
Components: Connectors / Kafka
Affects Versions: 1.14.0
Reporter: Brad Davis
Attempting to port a job that worked on 1.13.2 over to 1.14.0 I encountered
[this|https://gist.github.com/jherico/1f2d1cf441a4a9724ae370c375c90fde] error.
Going into the code I discovered that the reason seems to be [this
logic|https://github.com/apache/flink/blob/master/flink-connectors/flink-connector-kafka/src/main/java/org/apache/flink/connector/kafka/source/metrics/KafkaSourceReaderMetrics.java#L297].
But the tags being examined here are generated at least partly by [this
code|https://github.com/apache/kafka/blob/trunk/clients/src/main/java/org/apache/kafka/clients/consumer/internals/Fetcher.java#L1937].
The tags always translate periods in the topic name to underscores, but the
code in KafkaSourceReaderMetrics uses the untransformed topic name in the
filter. Therefore if the topic name has a period in it the filtering logic
will _always_ fail.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
