Gabriel39 opened a new pull request, #68047: URL: https://github.com/apache/doris/pull/68047
### What problem does this PR solve? Related PR: #67631 Backport #67631 to branch-4.1. FileScannerV2 incorrectly uses the Thrift RPC message ceiling to limit Parquet metadata. Add the independent, mutable `parquet_metadata_size_limit` with a 256 MiB default, while preserving the file-size check and enforcing the limit before metadata allocation and the second read. Resolved a test insertion conflict by retaining the existing physical-split refinement test and adding the upstream footer tests. The added and removed code matches the upstream patch. ### Release note FileScannerV2 uses the independent `parquet_metadata_size_limit` configuration, defaulting to 256 MiB. ### Check List (For Author) - Validation: clang-format 16 check and `git diff --check` passed; full diff self-reviewed. - Unit tests: preserved the upstream footer tests. A local `NewParquetReaderTest.NativeFooter*` run was attempted but stopped during a full rebuild; no local test result is claimed for this backport. CI validation is required. - Header hygiene: the check script is unavailable on the target branch. - Behavior changed: Yes; valid Parquet metadata above the RPC ceiling can be accepted within the dedicated metadata limit. - Does this need documentation: No. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
