anoopj commented on PR #15407: URL: https://github.com/apache/iceberg/pull/15407#issuecomment-6154411892
I work on both Delta Lake and Iceberg. I [raised](https://lists.apache.org/thread.html/np5dzr9bjzfyo7ql359hkdthdpw3fm4d) the sunsetting question earlier this year. I don't mind this PR getting merged, but my recommendation is to sunset this module in the long term. This is because UniForm handles the current conversion reasonably well. Note that metadata translation is expensive, regardless of who does the translation (UniForm or this module). So longer-term Delta Lake is [moving](https://docs.google.com/presentation/d/1WTzXcgHlQZzYz1MiZv_LdV-mZ1vfqJ5rkRXzF0755p4/edit?slide=id.p5#slide=id.p5) towards a unified content metadata with Iceberg v4. The v4 adaptive metadata tree will be used to store the content metadata in Delta. So the metadata representation will be the same on disk, making most translation unnecessary and improving out-of-the-box interoperability between the projects. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
