metanil commented on PR #55885: URL: https://github.com/apache/spark/pull/55885#issuecomment-5840412233
Thanks @peter-toth for SPARK-59121 and SPARK-59688 — between them they fix the co-partitioning issues this PR originally tried to address (reduced key spaces are now marked and compared via `TransformExpression.reducedWith`, and raw keys that still need reducing are no longer paired as they stand), so I've dropped that half and merged master into this branch. Btw, @peter-toth I modified the your `TransformFunctionId` to records each argument's shape as well. Thanks @sunchao for the original review. The raw-key issue you raised is now in the master with peters fix. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
