Lianhui Wang created SPARK-2648:
-----------------------------------
Summary: through shuffling blocksByAddress avoid much reducers to
fetch data from a executor at a time
Key: SPARK-2648
URL: https://issues.apache.org/jira/browse/SPARK-2648
Project: Spark
Issue Type: Improvement
Reporter: Lianhui Wang
like mapreduce we need to shuffle blocksByAddress.it can avoid many reducers to
connect a executor at a time.when a map has many paritions, at a time there has
so much reduces connecting to this map.so it maybe make network's connect to
timeout.
i created PR for this issue:https://github.com/apache/spark/pull/1549
--
This message was sent by Atlassian JIRA
(v6.2#6252)
