Szehon Ho created SPARK-54289:
---------------------------------
Summary: Allow MERGE INTO to preserve existing struct fields for
UPDATE SET * when source has less fields
Key: SPARK-54289
URL: https://issues.apache.org/jira/browse/SPARK-54289
Project: Spark
Issue Type: Improvement
Components: SQL
Affects Versions: 4.1.0
Reporter: Szehon Ho
Fix For: 4.1.0
SPARK-53482 allow source struct to have less fields than target struct.
However MERGE INTO statement with UPDATE SET * can be interpreted two ways.
Either replace entire struct (top level) or keep the fields in target not in
source.
The current behavior is the first option, but we should allow users the second
option to prevent inadvertent data loss.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
