Burak Yavuz created SPARK-19774: ----------------------------------- Summary: StreamExecution should call stop() on sources when a stream fails Key: SPARK-19774 URL: https://issues.apache.org/jira/browse/SPARK-19774 Project: Spark Issue Type: Bug Components: Structured Streaming Affects Versions: 2.1.0, 2.0.2 Reporter: Burak Yavuz Assignee: Burak Yavuz
We call stop() on a Structured Streaming Source only when the stream is shutdown when a user calls streamingQuery.stop(). We should actually stop all sources when the stream fails as well, otherwise we may leak resources, e.g. connections to Kafka. -- This message was sent by Atlassian JIRA (v6.3.15#6346) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org