BlakeOrth opened a new pull request, #18780: URL: https://github.com/apache/datafusion/pull/18780
## Which issue does this PR close? This is a follow-on PR spurred by this comment chain: - https://github.com/apache/datafusion/pull/18146#discussion_r2491693118 This work is associated with: - https://github.com/apache/datafusion/issues/17211 ## Rationale for this change The implementation prior to merging https://github.com/apache/datafusion/pull/18146 was capable of only listing files under a specific prefix when the known prefixes could be matched to filters. This PR re-introduces that capability, alleviating the need to list and filter every file for a table when the filters match. ## What changes are included in this PR? - Adds the ability to list files backing a table URL optionally filtered by a path prefix - Reintroduces the ability for partitioned listing tables to only list prefixes that match an input filter - Adds tests for new functionality ## Are these changes tested? Yes. There is existing coverage on many of the changes, new tests have been added, and existing integration tests have been updated to show the change in behavior. ## Are there any user-facing changes? no ## cc @alamb -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
