peter-toth commented on PR #53142: URL: https://github.com/apache/spark/pull/53142#issuecomment-3563288763
> I just realized that we have `KeyGroupedShuffleSpec.keyPositions` available and probably it can be used to build the partitioning similary to how `HashShuffleSpec` does it. Let me validate the idea before merging. https://github.com/apache/spark/pull/53142/commits/903a06466c19d6a5ac5837d33a5f6472982962bf changes the implementation to use `keyPositions` instead of `clusteringMap`. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
