Steven Zhen Wu created FLINK-10774: -------------------------------------- Summary: connection leak when partition discovery is disabled and open throws exception Key: FLINK-10774 URL: https://issues.apache.org/jira/browse/FLINK-10774 Project: Flink Issue Type: Bug Components: Kafka Connector Affects Versions: 1.6.2, 1.5.5, 1.4.2 Reporter: Steven Zhen Wu Assignee: Steven Zhen Wu
Here is the scenario to reproduce the issue * partition discovery is disabled * open method throws an exception (e.g. when broker SSL authorization denies request) In this scenario, run method won't be executed. As a result, _partitionDiscoverer.close()_ won't be called. that caused the connection leak, because KafkaConsumer is initialized but not closed. That has caused outage that brought down our Kafka cluster, when a high-parallelism job got into a restart/failure loop. -- This message was sent by Atlassian JIRA (v7.6.3#76005)