[
https://issues.apache.org/jira/browse/SPARK-11074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14954314#comment-14954314
]
Marcelo Vanzin commented on SPARK-11074:
----------------------------------------
You're missing this bit of code in the method called by the one you reference:
https://github.com/apache/spark/blob/master/core/src/main/scala/org/apache/spark/util/Utils.scala#L658
If you look at {{ExecutorRunner.scala}} (used by standalone Worker daemons)
you'll see the cluster manager creates those directories.
And even if that were not the case, the app is not responsible for creating
{{java.io.tmpdir}}, which is the actual root when the cluster manager doesn't
say otherwise.
> Attempt to automatically create event log directory if it doesn't already
> exist
> -------------------------------------------------------------------------------
>
> Key: SPARK-11074
> URL: https://issues.apache.org/jira/browse/SPARK-11074
> Project: Spark
> Issue Type: Improvement
> Components: Spark Core
> Affects Versions: 1.5.1
> Reporter: Kay Ousterhout
> Assignee: Kay Ousterhout
> Priority: Minor
>
> Right now, if the log where event logs are to be placed (spark.eventLog.dir)
> doesn't already exist, the SparkContext fails to start. We should try to
> automatically create this directory.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
