Xiangrui Meng created SPARK-2522:
------------------------------------
Summary: Use TorrentBroadcastFactory as the default broadcast
factory
Key: SPARK-2522
URL: https://issues.apache.org/jira/browse/SPARK-2522
Project: Spark
Issue Type: Improvement
Components: Spark Core
Reporter: Xiangrui Meng
Assignee: Xiangrui Meng
HttpBroadcastFactory is the current default broadcast factory. It sends the
broadcast data to each worker one by one, which is slow when the cluster is
big. TorrentBroadcastFactory scales much better than http. Maybe we should make
torrent the default broadcast method.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
