suryaprasanna opened a new pull request, #17947: URL: https://github.com/apache/hudi/pull/17947
### Describe the issue this Pull Request addresses Reduces memory fetched to the driver during `getAllPartitions` API call by removing unused objects from the listing result. ### Summary and Changelog - Changed `List<StoragePathInfo>` to `List<Pair<StoragePath, Boolean>>` in FileSystemBackedTableMetadata.java:167 - Only extracts path and isDirectory flag from StoragePathInfo instead of keeping the entire object - Reduces memory footprint when listing large numbers of partitions ### Impact Performance improvement - reduces memory usage on the driver when listing partitions, especially beneficial for tables with many partitions. ### Risk Level Low - Refactoring that maintains the same functionality while reducing memory usage. ### Documentation Update None ### Contributor's checklist - [x] Read through [contributor's guide](https://hudi.apache.org/contribute/how-to-contribute) - [x] Enough context is provided in the sections above - [x] Adequate tests were added if applicable -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
