szehon-ho commented on PR #53360: URL: https://github.com/apache/spark/pull/53360#issuecomment-3652234696
Yes after chatting with @aokolnychyi this can be serious as it cause inadvertent data loss. For instance, previously the user doing MERGE has a source struct s with just one field, and the target struct s with 100 fields. The user doing UPDATE SET * in 4.0 will get a failure, and they will realize their mistake. But now that we relax it in 4.1, a user doing UPDATE SET * with schema evolution will lose the 99 fields not in source struct s (become null). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
