This is an automated email from the ASF dual-hosted git repository.
wenchen pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git.
from 6506616 [SPARK-27803][SQL][PYTHON] Fix column pruning for Python UDF
add 8949bc7 [SPARK-27665][CORE] Split fetch shuffle blocks protocol from
OpenBlocks
No new revisions were added by this update.
Summary of changes:
.../apache/spark/network/protocol/Encoders.java | 23 ++++
.../apache/spark/network/util/TransportConf.java | 9 ++
.../shuffle/ExternalShuffleBlockHandler.java | 49 ++++++--
.../network/shuffle/OneForOneBlockFetcher.java | 73 ++++++++++--
.../shuffle/protocol/BlockTransferMessage.java | 10 +-
.../shuffle/protocol/FetchShuffleBlocks.java | 130 +++++++++++++++++++++
.../shuffle/BlockTransferMessagesSuite.java | 3 +
.../shuffle/ExternalShuffleBlockHandlerSuite.java | 34 ++++--
.../shuffle/OneForOneBlockFetcherSuite.java | 86 ++++++++++++--
.../spark/network/netty/NettyBlockRpcServer.scala | 16 ++-
docs/sql-migration-guide-upgrade.md | 2 +
11 files changed, 400 insertions(+), 35 deletions(-)
create mode 100644
common/network-shuffle/src/main/java/org/apache/spark/network/shuffle/protocol/FetchShuffleBlocks.java
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
