Johan Lasperas created SPARK-55690:
--------------------------------------
Summary: Implement schema evolution for DSv2 AppendData,
OverwriteByExpression, OverwritePartitionsDynamic
Key: SPARK-55690
URL: https://issues.apache.org/jira/browse/SPARK-55690
Project: Spark
Issue Type: Sub-task
Components: SQL
Affects Versions: 4.2.0
Reporter: Johan Lasperas
Implement an analyzer rules that collect new columns/nested fields present in
the source query and not the target tables, and adds them to the target table
schema via a call to `catalog.alterTable()`
Pre-requisite: the DSv2 table reports capability `AUTOMATIC_SCHEMA_EVOLUTION`
Similar to: https://issues.apache.org/jira/browse/SPARK-52991
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
