[
https://issues.apache.org/jira/browse/SPARK-12001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15027871#comment-15027871
]
Apache Spark commented on SPARK-12001:
--------------------------------------
User 'JoshRosen' has created a pull request for this issue:
https://github.com/apache/spark/pull/9982
> StreamingContext cannot be completely stopped if the stop() call is
> interrupted
> -------------------------------------------------------------------------------
>
> Key: SPARK-12001
> URL: https://issues.apache.org/jira/browse/SPARK-12001
> Project: Spark
> Issue Type: Bug
> Components: Streaming
> Reporter: Josh Rosen
> Assignee: Josh Rosen
>
> If {{StreamingContext.stop()}} is interrupted midway through the call, the
> context will be marked as stopped but certain state will have not been
> cleaned up. Because the stopped flag will be set, subsequent {{stop()}} calls
> will be unable to finish stopping the context, preventing any new
> StreamingContexts from being created.
> We should mitigate this race condition by ensuring that the second {{stop()}}
> call is able to clean up the partially-stopped context.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]