Hari Shreedharan created SPARK-2582:
---------------------------------------

             Summary: Make Block Manager Master pluggable
                 Key: SPARK-2582
                 URL: https://issues.apache.org/jira/browse/SPARK-2582
             Project: Spark
          Issue Type: Bug
            Reporter: Hari Shreedharan


Today, there is no way to make the BMM pluggable. So if we want an HA BMM, that 
needs to replace the current one. Making this pluggable and selected based on a 
config makes it easy to select HA or non-HA one based on the application's 
preference. Streaming applications would be better off with an HA one, while a 
normal application would not care (since the RDDs can be regenerated).

Since communication from the Block Managers to the BMM is via akka, we can keep 
that the same and just have the implementation of the BMM implement the actual 
methods which do the real work - this would not affect the Block Managers too.




--
This message was sent by Atlassian JIRA
(v6.2#6252)

Reply via email to