FatalLin opened a new pull request #32202: URL: https://github.com/apache/spark/pull/32202
### What changes were proposed in this pull request? I thought that the reader didn't scan the files under sub-directory even the configurtions such like "hive.mapred.supports.subdirectories" or "mapred.input.dir.recursive" is setted, so I developed a function which will list all the sub-directories under the root path when "hive.mapred.supports.subdirectories" is on. ### Why are the changes needed? Hive already have configurations to handle similar issues, but the built-in reader couldn't. ### Does this PR introduce _any_ user-facing change? Yes, maybe we could add this option in documents to notice users for the enhancement. ### How was this patch tested? New tests. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
