Hari Shreedharan created SPARK-2582:
---------------------------------------
Summary: Make Block Manager Master pluggable
Key: SPARK-2582
URL: https://issues.apache.org/jira/browse/SPARK-2582
Project: Spark
Issue Type: Bug
Reporter: Hari Shreedharan
Today, there is no way to make the BMM pluggable. So if we want an HA BMM, that
needs to replace the current one. Making this pluggable and selected based on a
config makes it easy to select HA or non-HA one based on the application's
preference. Streaming applications would be better off with an HA one, while a
normal application would not care (since the RDDs can be regenerated).
Since communication from the Block Managers to the BMM is via akka, we can keep
that the same and just have the implementation of the BMM implement the actual
methods which do the real work - this would not affect the Block Managers too.
--
This message was sent by Atlassian JIRA
(v6.2#6252)