gengliangwang commented on code in PR #38567:
URL: https://github.com/apache/spark/pull/38567#discussion_r1028627819
##########
core/src/main/scala/org/apache/spark/internal/config/Status.scala:
##########
@@ -70,4 +70,11 @@ private[spark] object Status {
.version("3.0.0")
.booleanConf
.createWithDefault(false)
+
+ val LIVE_UI_LOCAL_STORE_DIR = ConfigBuilder("spark.ui.store.path")
+ .doc("Local directory where to cache application information for live UI.
By default this is " +
+ "not set, meaning all application information will be kept in memory.")
Review Comment:
> how does this or will this interact with spark.history.store.path? do we
want to explicitly put live in the name of the config to make it clear if they
are totally separate?
If the RocksDB instance is gracefully closed, SHS can set the backend as
RocksDB and start with the instance from the live UI.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]