[
https://issues.apache.org/jira/browse/SPARK-11074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14954019#comment-14954019
]
Kay Ousterhout commented on SPARK-11074:
----------------------------------------
For the first issue (that the user doesn't have permission to create the
directory), it seems like things will work fine -- the command to create the
directory will fail, and we're no worse off than before this change.
What do you mean by the "right" permissions here?
The race seems like an issue, but one that's not very likely to occur, and if
it does happen, the command to create the directory will fail the second time,
and again it seems like the user is no worse off than before the change.
I've had many folks complain to me about this issue, so I think it's worth
fixing.
> Attempt to automatically create event log directory if it doesn't already
> exist
> -------------------------------------------------------------------------------
>
> Key: SPARK-11074
> URL: https://issues.apache.org/jira/browse/SPARK-11074
> Project: Spark
> Issue Type: Improvement
> Components: Spark Core
> Affects Versions: 1.5.1
> Reporter: Kay Ousterhout
> Assignee: Kay Ousterhout
> Priority: Minor
>
> Right now, if the log where event logs are to be placed (spark.eventLog.dir)
> doesn't already exist, the SparkContext fails to start. We should try to
> automatically create this directory.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
