This is an automated email from the ASF dual-hosted git repository.
mbutrovich pushed a change to branch main
in repository https://gitbox.apache.org/repos/asf/datafusion-comet.git
from 6c34c7a59 fix: native shuffle now reports spill metrics correctly
(#3197)
add cb49ff6ca chore: split CometShuffleExternalSorter into sync/async
implementations (#3192)
No new revisions were added by this update.
Summary of changes:
.../shuffle/sort/CometShuffleExternalSorter.java | 407 +++------------------
...r.java => CometShuffleExternalSorterAsync.java} | 135 +++----
...er.java => CometShuffleExternalSorterSync.java} | 142 ++-----
.../shuffle/CometUnsafeShuffleWriter.java | 2 +-
4 files changed, 133 insertions(+), 553 deletions(-)
copy
spark/src/main/java/org/apache/spark/shuffle/sort/{CometShuffleExternalSorter.java
=> CometShuffleExternalSorterAsync.java} (79%)
copy
spark/src/main/java/org/apache/spark/shuffle/sort/{CometShuffleExternalSorter.java
=> CometShuffleExternalSorterSync.java} (68%)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]