GitHub user His-name-is-Joof opened a pull request:
https://github.com/apache/spark/pull/6380
[Spark 7786] Allow StreamingListener to be specified in SparkConf and
loaded when creating StreamingContext
Add SparkConf option spark.streamingListeners to implement similar
functionality to spark.extraListeners defined in
[[SPARK-5411]](https://issues.apache.org/jira/browse/SPARK-5411).
Also modifies StatsReportListener to have a zero-valued constructor and
adds a simple test
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/His-name-is-Joof/spark SparkConf_Listeners
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/6380.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #6380
----
commit 73549ffa481038fc01b54f196ceb570b180231d2
Author: Jeff Harrison <[email protected]>
Date: 2015-05-21T17:45:26Z
Add func setupStreamingListeners to add listeners from
spark.streamingListeners
commit 4eb6987a72c97894ab193f08d1b1f1153e457e66
Author: Jeff Harrison <[email protected]>
Date: 2015-05-23T13:50:09Z
Merge branch 'master' into SparkConf_Listeners
commit f8ad6293ccd8dcd8c0c58b7a6a1ea2fe378c204b
Author: Jeff Harrison <[email protected]>
Date: 2015-05-23T18:08:19Z
Use class API to add listener. Modify StatsReportListener to have a zero
argument constructor in order to make it compatible with config option.
commit 3c1a19d70d1a20a882f1a44215a7a0bb6a5320c6
Author: Jeff Harrison <[email protected]>
Date: 2015-05-23T18:15:59Z
Reduced ambiguity by removing default values from StatsReportListener's
single-valued
constructor. Added docs for config option spark.streamingListeners
commit f3a3fee1af2ada6eb430894f4421ef6bfbd76ad5
Author: Jeff Harrison <[email protected]>
Date: 2015-05-23T18:57:13Z
Add test
commit e8506d4087c174cfa6e1994f66c1f30560ba8dc7
Author: Jeff Harrison <[email protected]>
Date: 2015-05-23T19:01:19Z
Fix minor syntax derp
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
