discivigour opened a new pull request, #8504: URL: https://github.com/apache/paimon/pull/8504
### Purpose This PR prunes unnecessary source columns before building the Ray join for data-evolution `MERGE INTO` matched updates. Previously, `build_matched_update_ds` renamed and joined all columns from the source dataset, even when a matched update only needed the join keys, a few `s.*` columns in update expressions, or `s.*` columns referenced by matched conditions. This could push unrelated wide columns, such as payload/blob/image columns, into Ray join and shuffle. ### Tests - test_matched_source_projection_prunes_unneeded_cols() -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
