tonymtu opened a new pull request, #9071: URL: https://github.com/apache/paimon/pull/9071
### Purpose `RESTTokenFileIO` currently inherits the default `FileIO#listFilesIterative` implementation. The default implementation is backed by `listStatus`, so it hides an optimized iterative listing implementation provided by the inner `FileIO` and can materialize a complete directory listing. Delegate `listFilesIterative` to the token-backed inner `FileIO`, preserving its lazy and paginated listing behavior after the token is refreshed. ### Tests - Added `RESTTokenFileIOTest#testListFilesIterativeReachesInnerOverride`. The test failed before the implementation change and passes afterward. - `mvn -pl paimon-common -DwildcardSuites=none -Dtest=RESTTokenFileIOTest test` - `mvn -pl paimon-common test` (`12,243` tests passed) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
