AngersZhuuuu opened a new pull request, #35799: URL: https://github.com/apache/spark/pull/35799
### What changes were proposed in this pull request? Currently, if user want to add an customized StreamingListener to StreamingContext, we need to add this listener in customized code. ``` streamingContext.addStreamingListener() ``` In this pr, we can define customized StreamingListener by set conf ``` spark.streaming.extraListeners ``` And it can support two constructor 1. No construct parameter 2. one constructor parameter of `SparkConf` ### Why are the changes needed? Some time we want to add some common StreamingListener to do some customized analysis, it is noisy to do this for all job, with this configuration, we can do this together just by setting a common env. ### Does this PR introduce _any_ user-facing change? User can set StreamingContext by set configuration ``` spark.streaming.extraListeners ``` ### How was this patch tested? Added UT -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
