Github user tdas commented on the pull request:
https://github.com/apache/spark/pull/7249#issuecomment-119052482
I think the design of this PR should be the following. The StreamingSource
object is currently registered at the time of creating the StreamingContext.
Instead it should be registered at the time of starting the context, and
deregistered when StreamingContext.stop() is called. Since there can only be
one StreamingContext that is active (that is, started and stopped), the problem
in the JIRA does not arise.
Furthemore, please add some description in the PR to explain the problem
and high design of the solution.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
