[ https://issues.apache.org/jira/browse/SPARK-31047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Dongjoon Hyun resolved SPARK-31047. ----------------------------------- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 27801 [https://github.com/apache/spark/pull/27801] > Improve file listing for ViewFileSystem > --------------------------------------- > > Key: SPARK-31047 > URL: https://issues.apache.org/jira/browse/SPARK-31047 > Project: Spark > Issue Type: Improvement > Components: SQL > Affects Versions: 3.1.0 > Reporter: Manu Zhang > Assignee: Manu Zhang > Priority: Minor > Fix For: 3.1.0 > > > https://issues.apache.org/jira/browse/SPARK-27801 has improved file listing > for DistributedFileSystem, where {{InMemoryFileIndex.listLeafFiles}} makes > use of DistributedFileSystem's one single {{listLocatedStatus}} to namenode. > This ticket intends to improve the case where ViewFileSystem is used to > manage multiple DistributedFileSystems. It has also overridden the > {{listLocatedStatus}} method by delegating to the filesystem it resolves to, > e.g. DistributedFileSystem. -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org