Szehon Ho created SPARK-54721:
---------------------------------
Summary: Completely disable feature 'nested struct coercion' for
MERGE INTO
Key: SPARK-54721
URL: https://issues.apache.org/jira/browse/SPARK-54721
Project: Spark
Issue Type: Sub-task
Components: SQL
Affects Versions: 4.1.0
Reporter: Szehon Ho
As https://github.com/apache/spark/pull/53326 is not allowed for Spark 4.1 , we
should disable the feature completely then. It doesn't make sense to allow the
user to opt-in the feature, when we plan to completely change the meaning for
subsequent releases.
Background, without this, there is a risk of data loss, because values for
nested field that do not exist in source are all nullified in MERGE INTO with
UPDATE SET *
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
