[
https://issues.apache.org/jira/browse/SPARK-2126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14037692#comment-14037692
]
Patrick Wendell commented on SPARK-2126:
----------------------------------------
Hey All,
This proposal is a fairly hairy refactoring of Spark internals. It might not be
the best candidate for an external contribution. [~CodingCat] if you wanted to
take a initial attempt at this, go right ahead! Just a warning though, it might
be that we use your code as a starting point for the design.
The final version of this patch will probably need to be written by someone who
has worked a lot on these internals ([~markhamstra] you'd actually be a good
candidate yourself! but not sure you have the cycles).
> Move MapOutputTracker behind ShuffleManager interface
> -----------------------------------------------------
>
> Key: SPARK-2126
> URL: https://issues.apache.org/jira/browse/SPARK-2126
> Project: Spark
> Issue Type: Sub-task
> Components: Shuffle, Spark Core
> Reporter: Matei Zaharia
> Assignee: Nan Zhu
>
> This will require changing the interface between the DAGScheduler and
> MapOutputTracker to be method calls on the ShuffleManager instead. However,
> it will make it easier to do push-based shuffle and other ideas requiring
> changes to map output tracking.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
