LuciferYang commented on code in PR #36200:
URL: https://github.com/apache/spark/pull/36200#discussion_r945898011
##########
core/src/main/scala/org/apache/spark/internal/config/package.scala:
##########
@@ -714,6 +715,16 @@ package object config {
.booleanConf
.createWithDefault(true)
+ private[spark] val SHUFFLE_SERVICE_DB_BACKEND =
+ ConfigBuilder(Constants.SHUFFLE_SERVICE_DB_BACKEND)
+ .doc("Specifies a disk-based store used in shuffle service local db. " +
+ "Only LEVELDB is supported now.")
+ .version("3.4.0")
+ .stringConf
+ .transform(_.toUpperCase(Locale.ROOT))
+ .checkValues(DBBackend.values.map(_.toString).toSet)
+ .createWithDefault(DBBackend.LEVELDB.name)
Review Comment:
The purpose of doing this is to use RocksDB more smoothly(like SHS using
RocksDB), I have never thought of making it completely pluggable.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
