Github user tdas commented on the pull request:
https://github.com/apache/spark/pull/1755#issuecomment-60014231
Hey @joyyoj
This is a very cool functionality! In fact, we had added a subset of this
functionality (sink) as part Spark 1.1, thus validating your approach. However,
while this approach provides more functionality, it does at the cost of
maintaining this, debugging this, and the cost of addition dependencies like to
the spark project, like zookeeper, etc.
We are seeing a lot of such big contributions from the community, which is
very encouraging and useful, but will be very hard to maintain for us. So we
are trying to figure out a way by which the community can contribute such
custom functionality, and maintain it themselves. Say something like a contribs
repo...
I will let you know when we have figured something out. Till then please
bear with us. :)
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
