GitHub user tgravescs opened a pull request:
https://github.com/apache/spark/pull/21234
[SPARK-24124] Spark history server should create spark.history.store.â¦
â¦path and set permissions properly
## What changes were proposed in this pull request?
Spark history server should create spark.history.store.path and set
permissions properly. Note createdDirectories doesn't do anything if the
directories are already created. This does not stomp on the permissions if the
user had manually created the directory before the history server could.
## How was this patch tested?
Manually tested in a 100 node cluster. Ensured directories created with
proper permissions. Ensured restarted worked apps/temp directories worked as
apps were read.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/tgravescs/spark SPARK-24124
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/21234.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #21234
----
commit f199f9a96190f10cb2f11ed646ba2b306dc13e9f
Author: Thomas Graves <tgraves@...>
Date: 2018-05-03T16:08:22Z
[SPARK-24124] Spark history server should create spark.history.store.path
and set permissions properly
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
