viirya commented on PR #5788: URL: https://github.com/apache/datafusion-comet/pull/5788#issuecomment-5606530573
@andygrove Thanks, both points are addressed in 8d9eede01 and the updated PR description. The comment now identifies Comet JVM shuffle as the baseline for default `auto` mode with nested hashing disabled. The replacement results table includes all four arms from one complete run, with a JVM/native ratio for every shape and partition count. I retained the singleton-map control and added maps with 2–10 and 2–50 distinct entries per row, each in forward and reversed input order. The results do not support a general claim that maps are unaffected: for the 2–50-entry reversed case at 201 partitions, native took 2,449 ms versus 2,107 ms for JVM shuffle. I removed that claim and documented that these end-to-end, sequential measurements do not isolate sorting or hashing costs. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
