techguruonline commented on issue #15286:
URL: https://github.com/apache/iceberg/issues/15286#issuecomment-3880622569
thanks @szehon-ho for the comment, when you say 'withSchemaEvolution' should
now work completely, which version of Spark does it work? I tried with Spark
4.0 and even with 'withSchemaEvolution' option, it fails at the analysis phase
source_df.mergeInto(
table="catalog.db.target_table",
condition=expr("source.id = catalog.db.target_table.id")
).withSchemaEvolution()
.whenMatched().updateAll()
.whenNotMatched().insertAll()
.merge()
Error:
AnalysisException: [UNRESOLVED_COLUMN.WITH_SUGGESTION] A column, variable, or
function parameter with name source.id cannot be resolved.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
