kbendick opened a new pull request #3440: URL: https://github.com/apache/iceberg/pull/3440
This test ensures that there are no regressions to SPARK-34720 that will affect Iceberg. Prior to SPARK-34720, columns were resolved in the MERGE INTO plan by ordinal position. This could cause data to be silently corrupted if two columns were switched, but the source and target table's had the same schema otherwise. E.g. if source was (id int, v int, dep string) and target was (v int, id int, dep string), the values from v and id could possibly be placed into the wrong column causing silent data corruption. This is a Spark bug, but given that it can affect data integrity, it's good to have a test to ensure there's no regression that could cause Iceberg users issues. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
