This is an automated email from the ASF dual-hosted git repository.
vanzin pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git.
from 1a3858a [SPARK-26985][CORE] Fix "access only some column of the all
of columns " for big endian architecture BUG
add b71c130 [SPARK-27622][CORE] Avoiding the network when block manager
fetches disk persisted RDD blocks from the same host
No new revisions were added by this update.
Summary of changes:
.../spark/network/shuffle/ExecutorDiskUtils.java | 66 +++++++++++
.../shuffle/ExternalShuffleBlockResolver.java | 45 +-------
.../shuffle/ExternalShuffleBlockResolverSuite.java | 2 +-
.../network/shuffle/TestShuffleDataContext.java | 9 +-
.../org/apache/spark/storage/BlockManager.scala | 121 ++++++++++++++++----
.../apache/spark/storage/BlockManagerMaster.scala | 13 ++-
.../spark/storage/BlockManagerMasterEndpoint.scala | 32 ++++--
.../spark/storage/BlockManagerMessages.scala | 17 ++-
.../apache/spark/storage/DiskBlockManager.scala | 5 +-
.../spark/storage/BlockManagerInfoSuite.scala | 1 +
.../apache/spark/storage/BlockManagerSuite.scala | 124 +++++++++++++++++++--
11 files changed, 342 insertions(+), 93 deletions(-)
create mode 100644
common/network-shuffle/src/main/java/org/apache/spark/network/shuffle/ExecutorDiskUtils.java
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
