andygrove opened a new pull request, #6877: URL: https://github.com/apache/datafusion-comet/pull/6877
## Which issue does this PR close? Closes #6131. Backport of #6766 and #6862 to `branch-1.1`. ## Rationale for this change DataFusion 55.2.0 contains patch fixes relevant to the 1.1 release line, including preserving fetch limits during distribution reoptimization and retaining field metadata while coercing INT96 timestamps. Losing that metadata causes Parquet columns identified only by a container field ID to be read as null. ## What changes are included in this PR? Cherry-picks #6766 and its regression coverage from #6862 with `-x`. This bumps the 1.1 branch from DataFusion 55.1.0 to 55.2.0, refreshes the native and Delta lockfiles, updates the INT96 metadata comment, and adds native Parquet scan tests for field IDs on struct, list, map, nested struct, and Variant containers. The backport preserves the 1.1 dependency graph, omitting `datafusion-functions` and `comet-test-udfs` entries that were added on `main` after the branch cut. ## How are these changes tested? Ran: ```text cd native && cargo fmt --all -- --check cd native && cargo check --workspace --all-targets --locked cd contrib/delta/native && cargo check --locked --all-targets make core ./mvnw test -Dtest=none -Dsuites='org.apache.comet.parquet.ParquetReadV1Suite INT96' -Dscalastyle.skip=true ``` Result: native and Delta checks passed; the focused Parquet suite completed with 5 tests passed. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
