Akash3121 opened a new pull request, #942: URL: https://github.com/apache/incubator-xtable/pull/942
This PR restores source-to-target commit identifier tracking for the Delta Kernel path in support of issue #819. Delta Kernel 4.0.0 does not expose the commit-tag flow used by the legacy Delta implementation, so XTable uses Delta Kernel domain metadata to persist the source commit identifier on the target commit and resolve it later from the latest transaction version. This PR also restores Delta nested schema metadata propagation, Glue Delta storage-descriptor fields, and the Parquet limitations documentation that accompany the Delta Kernel work. ### Notes to reviewer - Delta Kernel commit mapping now uses domain metadata, not commit tags. - The schema extractor changes preserve column-mapping IDs, physical names, and nested IDs for arrays and maps. - The Glue and docs updates are supporting fixes that came out of review, not the primary feature. - Targeted unit tests for the touched modules pass; the broader `TestDeltaKernelSync` suite still hits the known Windows Hadoop/native limitation in this environment. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
