zhouyuan commented on issue #9225: URL: https://github.com/apache/incubator-gluten/issues/9225#issuecomment-2778916169
Iceberg support https://github.com/apache/incubator-gluten/issues/8953 Read: - Support reading CoW - done - Support reading MOR - basic support ready, w/o equality delete - Equality delete support Design: https://github.com/facebookincubator/velox/issues/8748 Patch: https://github.com/facebookincubator/velox/pull/11088 Gluten patch: https://github.com/apache/incubator-gluten/pull/8056 Positional delete: https://github.com/facebookincubator/velox/pull/12590 Writing - fallback with JVM code, we need a design on this - CoW vs MoR: this should be handled in Spark iceberg connector - Non-bucket: https://github.com/facebookincubator/velox/pull/10996 - Bucket: pending on new patch from velox community - Write data from gluten, metadata write from JVM spark Unit tests coverage: https://github.com/apache/incubator-gluten/issues/8932 Performance report: Iceberg perf: Java vs. native Documents update: TBD -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
