[
https://issues.apache.org/jira/browse/SPARK-11074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14954105#comment-14954105
]
Kay Ousterhout commented on SPARK-11074:
----------------------------------------
In my opinion we should minimize the amount of work someone has to do to get
Spark up and running. The folks who have mentioned this to me either (1) just
wanted the logs somewhere, and are happy with the default or (2) did set the
directory, but didn't realize they had to make the directory themselves.
It sounds like we have a fundamental disagreement about what a typical user
would want here, so I'm curious to hear others weigh in.
> Attempt to automatically create event log directory if it doesn't already
> exist
> -------------------------------------------------------------------------------
>
> Key: SPARK-11074
> URL: https://issues.apache.org/jira/browse/SPARK-11074
> Project: Spark
> Issue Type: Improvement
> Components: Spark Core
> Affects Versions: 1.5.1
> Reporter: Kay Ousterhout
> Assignee: Kay Ousterhout
> Priority: Minor
>
> Right now, if the log where event logs are to be placed (spark.eventLog.dir)
> doesn't already exist, the SparkContext fails to start. We should try to
> automatically create this directory.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
