szehon-ho commented on PR #5516: URL: https://github.com/apache/iceberg/pull/5516#issuecomment-1218383697
Hi guys, just continuing on the discussion from the sync (where there was not consensus to proceed on this) I was thinking for these kind of use cases , Iceberg could potentially offer an 'export' functionality that writes either to a symlink manifest or just directory-based table. Then we could short-circuit and re-use existing files if there are no schema evolution, delete files, and maybe default values defined, or just do a rewrite if there are. Thinking it could be a nice kind of a nice counterpart to 'import', and also allow users who are primariily interested in the base features of Iceberg but not necessarily schema-evolution or merge-on-read a nice interop with non-Iceberg environments. @rdblue wondering if that makes more sense? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
