dongjoon-hyun commented on a change in pull request #30492:
URL: https://github.com/apache/spark/pull/30492#discussion_r532857177
##########
File path: core/src/main/scala/org/apache/spark/internal/config/package.scala
##########
@@ -471,6 +471,16 @@ package object config {
"cache block replication should be positive.")
.createWithDefaultString("30s")
+ private[spark] val STORAGE_DECOMMISSION_FALLBACK_STORAGE_PATH =
+ ConfigBuilder("spark.storage.decommission.fallbackStorage.path")
+ .doc("The location for fallback storage during block manager
decommissioning. " +
+ "For example, `s3a://spark-storage/`. In case of empty, fallback
storage is disabled. " +
+ "The storage should be managed by TTL because Spark will not clean up
it.")
Review comment:
Oops. Got it.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
