This is an automated email from the ASF dual-hosted git repository.
cloud-fan pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
from 74bd06e5cac8 Revert "[SPARK-56615][SQL] Throw overflow errors for ceil
and floor"
add 50932d2f0f1a [SPARK-57491][CORE] Prevent and detect stale push-based
shuffle data from duplicate map task attempts
No new revisions were added by this update.
Summary of changes:
.../org/apache/spark/BarrierTaskContext.scala | 9 ++
.../scala/org/apache/spark/MapOutputTracker.scala | 149 ++++++++++++++++++++-
.../main/scala/org/apache/spark/TaskContext.scala | 19 ++-
.../scala/org/apache/spark/TaskContextImpl.scala | 20 +++
.../scala/org/apache/spark/executor/Executor.scala | 3 +
.../apache/spark/scheduler/TaskSetManager.scala | 30 +++++
.../spark/shuffle/ShuffleWriteProcessor.scala | 26 +++-
.../spark/storage/PushBasedFetchHelper.scala | 54 +++++++-
.../org/apache/spark/util/taskListeners.scala | 17 +++
.../org/apache/spark/MapOutputTrackerSuite.scala | 54 +++++++-
.../apache/spark/scheduler/TaskContextSuite.scala | 70 ++++++++++
.../spark/scheduler/TaskSetManagerSuite.scala | 83 ++++++++++++
.../storage/ShuffleBlockFetcherIteratorSuite.scala | 81 +++++++++++
project/MimaExcludes.scala | 5 +-
14 files changed, 603 insertions(+), 17 deletions(-)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
