Thomas Graves created SPARK-24124:
-------------------------------------
Summary: Spark history server should create
spark.history.store.path and set permissions properly
Key: SPARK-24124
URL: https://issues.apache.org/jira/browse/SPARK-24124
Project: Spark
Issue Type: Story
Components: Spark Core
Affects Versions: 2.3.0
Reporter: Thomas Graves
Current with the new spark history server you can set spark.history.store.path
to a location to store the levelDB files. Currently the directory has to be
made before it can use that path.
We should just have the history server create it and set the file permissions
on the leveldb files to be restrictive -> new FsPermission((short) 0700)
the shuffle service already does this, this would be much more convenient to
use and prevent people from making mistakes with the permissions on the
directory and files.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
