Aaron Davidson created SPARK-4183:
-------------------------------------
Summary: Enable Netty-based BlockTransferService by default
Key: SPARK-4183
URL: https://issues.apache.org/jira/browse/SPARK-4183
Project: Spark
Issue Type: Bug
Reporter: Aaron Davidson
Assignee: Aaron Davidson
Spark's NettyBlockTransferService relies on Netty to achieve high performance
and zero-copy IO, which is a big simplification over the manual connection
management that's done in today's NioBlockTransferService. Additionally, the
core functionality of the NettyBlockTransferService has been extracted out of
spark core into the "network" package, with the intention of reusing this code
for SPARK-3796 ([PR
#3001|https://github.com/apache/spark/pull/3001/files#diff-54]).
We should turn NettyBlockTransferService on by default in order to improve
debuggability and stability of the network layer (which has historically been
more challenging with the current BlockTransferService).
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
