JanKaul commented on issue #6420: URL: https://github.com/apache/iceberg/issues/6420#issuecomment-1369499741
Thank you @rdblue for your detailed comments. I really like your idea about storing the refresh metadata in the snapshot. It really simplifies the design. I have a couple of questions to better understand your proposal. 1. To make sure I understood you correctly: you prefer "Design 2: Table + attached common view"? 2. How exactly would you store the metadata in the snapshot? Would you store the metadata as properties of the `summary` field? 3. How are multiple upstream table references stored in the metadata? Is the second entry (`table.<identifier>`) a list of table UUIDs and snapshot IDs? Because generally the materialized view definition can reference multiple upstream tables. Regarding the `type` field of the `base_table` record. I thought it might makes sense to allow future extensions. But you are right that only supporting "iceberg-metastore" tables would allow to further simplify the design. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
