Github user superbobry commented on the issue: https://github.com/apache/spark/pull/19458 On second thought, the documentation of `DiskBlockManager.getAllFiles` states that it returns all files in the directories managed by `DiskBlockManager`. Filtering anything would violate this contract, WDYT?
--- --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org