Github user tdas commented on the pull request:
https://github.com/apache/spark/pull/6380#issuecomment-111399359
Hey so, I thought about this feature a little bit. I am not this is an
essential feature.The spark.extraListeners was added so that listeners can get
added before SparkContext is started even in environments where the user does
not explicitly start the SparkContext, e.g. spark shell. Since the SparkContext
in the spark-shell is started automatically before the user gets any
opportunity to attach their own listener, the extraListener conf was added to
make sure the system automatically attaches them before creating any listener
event.
But StreamingContext is really never started automatically like
SparkContext in spark-shell. One can always add listeners before starting the
StreamingContext. So what is the usecase where this is really essential?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
