wirybeaver commented on issue #2201: URL: https://github.com/apache/iceberg-rust/issues/2201#issuecomment-4877829996
Thanks for the interest, @raghav-reglobe. To clarify the current plan and avoid duplication: I plan to own the full end-to-end implementation of `MERGE INTO` for CoW mode in iceberg-rust, from the DataFusion table provider integration through query planning to execution. The PoC branch referenced in the issue description already demonstrates this with comprehensive end-to-end tests as proof of the implementation. Since GitHub doesn't support stacked PRs for forked repos, I'm landing this as a series of incremental PRs to keep each one reviewable — posting thousands of lines in a single PR would not be productive for reviewers. The open-source review process is rigorous, so the landing pace is measured. The critical path for CoW `MERGE INTO` is: 1. `MERGE INTO` support is released in the next DataFusion version; iceberg-rust upgrades to that version. 2. RowDelta action fully supports CoW mode. 3. My incremental PRs for `MERGE INTO` get fully landed. If your team has an urgent internal need for MoR, I'd suggest branching off the PoC branch to unblock yourselves in the interim — but for the upstream contribution, I'll continue driving the CoW implementation to completion. That said, contributions are very welcome — particularly if someone wants to contribute additional query execution nodes (e.g., `MergeIntoExec` variants or custom physical operators) needed for MoR mode. Happy to coordinate to ensure the designs align. I will update the issue description with a design diagram within the next two days. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
