bryanck commented on PR #17499: URL: https://github.com/apache/iceberg/pull/17499#issuecomment-5402176544
In sum, we have 3+ options for view data types drifting from source. First is upcasting to the view schema (current Iceberg behavior). Second is casting to the view schema, and allowing any compatible cast including downcasts (the default for Spark 4 views IIUC). Third is rely on the source data types and evolve the view schema to match as needed. A variation of #3 is to rely on the source and do not update anything, i.e. ignore the view data types. Here I feel we should support the first 2 options, and consider the 3rd (with metadata update) as a follow-up, as that has more considerations like calling the catalog. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
