Tathagata Das created SPARK-7930:
------------------------------------
Summary: Shutdown hook deletes rool local dir before SparkContext
is stopped, throwing errors
Key: SPARK-7930
URL: https://issues.apache.org/jira/browse/SPARK-7930
Project: Spark
Issue Type: Bug
Components: Spark Core, Streaming
Reporter: Tathagata Das
Assignee: Tathagata Das
Shutdown hook for temp directories had priority 100 while SparkContext was 50.
So the local root directory was deleted before SparkContext was shutdown. This
leads to scary errors on running jobs, at the time of shutdown. This is
especially a problem when running streaming examples, where Ctrl-C is the only
way to shutdown.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
