kbendick commented on issue #5556: URL: https://github.com/apache/iceberg/issues/5556#issuecomment-1219070741
Also, what about a table property? Does the table experience writes where you explicitly _do not_ want `mergeSchema`? Generally, I think `mergeSchem` is safer as a per-query option and is somewhat unsafe as a table level configuration. But Spark makes it somehat hard to support that as there’s no Dataframe support for `MERGE INTO` currently. For the long run, I’m going to bring up adding a merge into API to the dataframe / dataset API in Spark. But that could take a while. We _might_ be able to provide implicit classes so that it’s do-able using the dataframe API in just Iceberg, but in the long run that should be moved to Spark (though that doesn’t solve your immediate problem, I know). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
