Github user pwendell commented on the pull request:
https://github.com/apache/spark/pull/1506#issuecomment-56289168
Hey @harishreedharan thanks for submitting, but like to close this PR for
now pending a more complete design proposal about how external implementations
of the block storage service would work. There are a bunch of other challenges
in decoupling the block storage service from the SparkContext... it's
definitely an interesting idea longer term but one that would need a thorough
design and consensus. If we make this pluggable it will signal to the community
that we want to head down this direction, so I'd propose getting a consensus on
that before proceeding.
For streaming specifically I know you and @tdas are working on some more
specific mechanisms to provide H/A in that case.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
