Jesper Lundgren created SPARK-4986:
--------------------------------------
Summary: Graceful shutdown for Spark Streaming does not work in
Standalone cluster mode
Key: SPARK-4986
URL: https://issues.apache.org/jira/browse/SPARK-4986
Project: Spark
Issue Type: Bug
Components: Streaming
Affects Versions: 1.2.0
Reporter: Jesper Lundgren
When using the graceful stop API of Spark Streaming in Spark Standalone cluster
the stop signal never reaches the receivers. I have tested this with Spark 1.2
and Kafka receivers.
ReceiverTracker will send StopReceiver message to ReceiverSupervisorImpl.
In local mode ReceiverSupervisorImpl receives this message but in Standalone
cluster mode the message seems to be lost.
Sent my own string message as a stop signal from ReceiverTracker to
ReceiverSupervisorImpl and it works as a workaround.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
