Ted Yu created SPARK-11761:
------------------------------
Summary: Prevent the call to StreamingContext#stop() in the
listener bus's thread
Key: SPARK-11761
URL: https://issues.apache.org/jira/browse/SPARK-11761
Project: Spark
Issue Type: Bug
Components: Streaming
Reporter: Ted Yu
Quoting Shixiong's comment from https://github.com/apache/spark/pull/9723 :
{code}
The user should not call stop or other long-time work in a listener since it
will block the listener thread, and prevent from stopping
SparkContext/StreamingContext.
I cannot see an approach since we need to stop the listener bus's thread before
stopping SparkContext/StreamingContext totally.
{code}
Proposed solution is to prevent the call to StreamingContext#stop() in the
listener bus's thread.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
