[
https://issues.apache.org/jira/browse/SPARK-11074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14954094#comment-14954094
]
Marcelo Vanzin commented on SPARK-11074:
----------------------------------------
bq. they don't get the "it just works" behavior that I think we should be
trying to provide.
They have to explicitly enable logs; why is it bad that Spark complains if
they've chosen to write logs to a location that doesn't exist?
That doubles as a good indication that the user forgot to set the log directory
in the first place, since the default is kinda useless.
> Attempt to automatically create event log directory if it doesn't already
> exist
> -------------------------------------------------------------------------------
>
> Key: SPARK-11074
> URL: https://issues.apache.org/jira/browse/SPARK-11074
> Project: Spark
> Issue Type: Improvement
> Components: Spark Core
> Affects Versions: 1.5.1
> Reporter: Kay Ousterhout
> Assignee: Kay Ousterhout
> Priority: Minor
>
> Right now, if the log where event logs are to be placed (spark.eventLog.dir)
> doesn't already exist, the SparkContext fails to start. We should try to
> automatically create this directory.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
