andygrove commented on issue #2904: URL: https://github.com/apache/datafusion-comet/issues/2904#issuecomment-3729420416
It turns out that the current microbenchmark is very misleading and is testing a pathological case for sort-based shuffle with a single row per output partition. It may be better to rely on TPC-* for benchmarking shuffle. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
