[
https://issues.apache.org/jira/browse/SPARK-19774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15889032#comment-15889032
]
Apache Spark commented on SPARK-19774:
--------------------------------------
User 'brkyvz' has created a pull request for this issue:
https://github.com/apache/spark/pull/17107
> StreamExecution should call stop() on sources when a stream fails
> -----------------------------------------------------------------
>
> Key: SPARK-19774
> URL: https://issues.apache.org/jira/browse/SPARK-19774
> Project: Spark
> Issue Type: Bug
> Components: Structured Streaming
> Affects Versions: 2.0.2, 2.1.0
> Reporter: Burak Yavuz
> Assignee: Burak Yavuz
>
> We call stop() on a Structured Streaming Source only when the stream is
> shutdown when a user calls streamingQuery.stop(). We should actually stop all
> sources when the stream fails as well, otherwise we may leak resources, e.g.
> connections to Kafka.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
