Chao Sun created SPARK-32880: -------------------------------- Summary: Improve and refactor parallel listing in HadoopFSUtils Key: SPARK-32880 URL: https://issues.apache.org/jira/browse/SPARK-32880 Project: Spark Issue Type: Improvement Components: Spark Core Affects Versions: 3.1.0 Reporter: Chao Sun
We have a few follow-ups after refactoring the parallel listing feature into Spark Core: # Expose metrics as a callback # Enhance listing support for S3A/other cloud `FileSystem` impls # Other cleanups and refactorings on the code. -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org