ei-grad commented on issue #9827: URL: https://github.com/apache/iceberg/issues/9827#issuecomment-3744634177
2026 update: `MERGE WITH SCHEMA EVOLUTION` should work with Spark 4.1 support added in Iceberg 1.11+ (current master). Another kind of summary of mentioned slack thread, for those who needs it, for history (still valid): The `write.spark.accept-any-schema` property disables Spark's column resolution rules during MERGE statements: 1. SPARK-30609 made Spark skip resolution when this property is set (to let data sources handle it) 2. In Spark 3.4, Iceberg handled MERGE internally, so resolution worked 3. In Spark 3.5+, MERGE moved to Spark core (SPARK-46207), but Spark skips resolution due to the property 4. Result: No resolution happens at all, causing `UNRESOLVED_COLUMN` errors -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
