This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git.
from 9f8e15b [SPARK-32034][SQL] Port HIVE-14817: Shutdown the
SessionManager timeoutChecker thread properly upon shutdown
add aa4c100 [SPARK-31798][SHUFFLE][API] Shuffle Writer API changes to
return custom map output metadata
No new revisions were added by this update.
Summary of changes:
.../spark/shuffle/api/ShuffleMapOutputWriter.java | 12 +++-
.../api/metadata/MapOutputCommitMessage.java | 64 ++++++++++++++++++++++
.../api/metadata/MapOutputMetadata.java} | 15 ++---
.../shuffle/sort/BypassMergeSortShuffleWriter.java | 4 +-
.../spark/shuffle/sort/UnsafeShuffleWriter.java | 4 +-
.../sort/io/LocalDiskShuffleMapOutputWriter.java | 5 +-
.../spark/shuffle/sort/SortShuffleWriter.scala | 2 +-
.../io/LocalDiskShuffleMapOutputWriterSuite.scala | 2 +-
8 files changed, 90 insertions(+), 18 deletions(-)
create mode 100644
core/src/main/java/org/apache/spark/shuffle/api/metadata/MapOutputCommitMessage.java
copy
core/src/main/java/org/apache/spark/{api/java/function/ForeachFunction.java =>
shuffle/api/metadata/MapOutputMetadata.java} (71%)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
