[
https://issues.apache.org/jira/browse/SPARK-11074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14954090#comment-14954090
]
Kay Ousterhout commented on SPARK-11074:
----------------------------------------
Using 1777 as the default seems fine -- but for all of the more complex cases
you mentioned, those all sound like things where the user would go to the
trouble of creating the directory themselves rather than relying on Spark to
create it. Also, the person running Spark could retroactively change the
permissions, right? So again, they're no worse off than before this change?
I'm trying to optimize for the non-knowledgable user: someone who starts Spark
in a simple environment (maybe even just locally), wants some event logs, and
they don't get the "it just works" behavior that I think we should be trying to
provide.
> Attempt to automatically create event log directory if it doesn't already
> exist
> -------------------------------------------------------------------------------
>
> Key: SPARK-11074
> URL: https://issues.apache.org/jira/browse/SPARK-11074
> Project: Spark
> Issue Type: Improvement
> Components: Spark Core
> Affects Versions: 1.5.1
> Reporter: Kay Ousterhout
> Assignee: Kay Ousterhout
> Priority: Minor
>
> Right now, if the log where event logs are to be placed (spark.eventLog.dir)
> doesn't already exist, the SparkContext fails to start. We should try to
> automatically create this directory.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
