varun-lakhyani opened a new pull request, #15028: URL: https://github.com/apache/iceberg/pull/15028
Extends Tests for PR #14970 for feature which will be available with spark 4.1.1. This PR creates a test for MERGE INTO schema evolution in nested case where source has fewer fields than target and by default it keeps the non existing fields in target intact and null for new source rows. Spark Updates can be found at https://issues.apache.org/jira/browse/SPARK-54274 This specific feature https://issues.apache.org/jira/browse/SPARK-54621 Includes a TODO to enable (remove Disabled annotation) for the test when spark 4.1 is updated to 4.1.1, when #14946 is merged. It also renames an existing nested test like other tests so can be better understood (`testMergeWithSchemaEvolutionNestedStruct()` -> `testMergeWithSchemaEvolutionNestedStructSourceHasMoreFields()`) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
