Github user rvesse commented on a diff in the pull request:
https://github.com/apache/spark/pull/22323#discussion_r215625448
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/Config.scala
---
@@ -225,6 +225,15 @@ private[spark] object Config extends Logging {
"Ensure that major Python version is either Python2 or Python3")
.createWithDefault("2")
+ val KUBERNETES_LOCAL_DIRS_TMPFS =
+ ConfigBuilder("spark.kubernetes.local.dirs.tmpfs")
+ .doc("If set to true then emptyDir volumes created to back
spark.local.dirs will have " +
+ "their medium set to Memory so that they will be created as tmpfs
(i.e. RAM) backed " +
+ "volumes. This may improve performance but scratch space usage
will count towards " +
+ "your pods memory limit so you may wish to request more memory.")
+ .booleanConf
--- End diff --
Fixed
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
