Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/19934#discussion_r155922544
--- Diff: core/src/main/scala/org/apache/spark/util/Utils.scala ---
@@ -829,7 +829,18 @@ private[spark] object Utils extends Logging {
}
private def getOrCreateLocalRootDirsImpl(conf: SparkConf): Array[String]
= {
--- End diff --
Note that, this seems only being called via
`Utils.getOrCreateLocalRootDirs` which caches `localRootDirs`. So, I think this
won't mess up logs.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]