umehrot2 opened a new pull request #2326: URL: https://github.com/apache/hudi/pull/2326
## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contributing.html before opening a pull request.* ## What is the purpose of the pull request This is part of the on-going work with the community on RFC-15 and is based off the branch https://github.com/apache/hudi/tree/rfc-15 where we are building this feature. This implements reader side changes to be able to use metadata based file listing inside HoodieROTablePathFilter. This Path Filter is used within Spark and Presto to filter out the files from latest commit, in case of Copy On Write tables. For this it needs to fetch the FileSystemView which provides latest snapshot of the files. This adds a new FileSystemView which can fetch the file listing using the Hudi backed metadata table. ## Verify this pull request - Added unit test - Tested on EMR cluster ## Committer checklist - [ ] Has a corresponding JIRA in PR title & commit - [ ] Commit message is descriptive of the change - [ ] CI is green - [ ] Necessary doc changes done or have another open PR - [ ] For large changes, please consider breaking it into sub-tasks under an umbrella JIRA. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
