voonhous opened a new pull request, #13787: URL: https://github.com/apache/hudi/pull/13787
### Change Logs Upstreaming a bunch of Trino improvements to Hudi-Trino and they are: 1. Increase Default MaxOutstandingSplits and SplitLoaderParallelism 2. [HUDI-9525](https://issues.apache.org/jira/browse/HUDI-9525) Extend file system cache support to Hudi connector - Note that all NON trino-hudi-plugin related code changes are excluded in the cherrypick 3. Fix split generation parallelism for a non-partitioned table 4. ~~[MINOR] Disable PR labeler~~ (Skipped as this is modifies a file in .github/workflows) 5. ~~Add parquet page skipping in Iceberg Connector~~ (Skipped as this is for testing purposes) 6. ~~[HUDI-9577](https://issues.apache.org/jira/browse/HUDI-9577) Make target result size configurable from endpoint and server~~ (Skipped as all changes made are in non-hudi related trino modules) 7. ~~Create pipeline to build arm image~~ (Skipped as this modifies github actions) 8. [MINOR] Revert changes made to non-hudi modules 9. [MINOR] Added optimizations for HudiColumnStatsIndexSupport 10. [MINOR] Cleanup HudiSplitFactory to extend cache support 11. Fix flakiness when testing cache correctness 12. [Trino] Enable Metadata Table by default 13. [Trino] Fix flaky tests due to table stats computation lagging behind query execution 14. Implement Metadata table based Partition listing - Changes in trino-hive are ignored 15. Fix Case Sensitivity Issues Between Table and Catalog Schemas 16. [Trino] Workers should use latest commit time from table handle 17. Incorrect query results for Merge-On-Read (RT) tables when column stats are enabled Upstream **STARTS** at commit hash (inclusive): ea7f22d0371173a31be0c693a24fa00b7374fe0f Upstream **ENDS** at commit hash (inclusive): 5e3ebd5b4edd0623e041109cc769f0123bcbd4a7 ### Impact None ### Risk level (write none, low medium or high below) None ### Documentation Update _Describe any necessary documentation update if there is any new feature, config, or user-facing change. If not, put "none"._ - _The config description must be updated if new configs are added or the default value of the configs are changed_ - _Any new feature or user-facing change requires updating the Hudi website. Please create a Jira ticket, attach the ticket number here and follow the [instruction](https://hudi.apache.org/contribute/developer-setup#website) to make changes to the website._ ### Contributor's checklist - [ ] Read through [contributor's guide](https://hudi.apache.org/contribute/how-to-contribute) - [ ] Change Logs and Impact were stated clearly - [ ] Adequate tests were added if applicable - [ ] CI passed -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
