GitHub user vanzin opened a pull request:
https://github.com/apache/spark/pull/19309
[SPARK-19558][sql] Add config key to register QueryExecutionListeners
automatically.
This change adds a new SQL config key that is equivalent to SparkContext's
"spark.extraListeners", allowing users to register QueryExecutionListener
instances through the Spark configuration system instead of having to
explicitly do it in code.
The code used by SparkContext to implement the feature was refactored into
a helper method in the Utils class, and SQL's ExecutionListenerManager was
modified to use it to initialize listener declared in the configuration.
Unit tests were added to verify all the new functionality.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/vanzin/spark SPARK-19558
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/19309.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #19309
----
commit c52fd71899b136d79202eeb2c6502e2845b19714
Author: Marcelo Vanzin <[email protected]>
Date: 2017-09-20T22:58:23Z
[SPARK-19558][sql] Add config key to register QueryExecutionListeners
automatically.
This change adds a new SQL config key that is equivalent to SparkContext's
"spark.extraListeners", allowing users to register QueryExecutionListener
instances through the Spark configuration system instead of having to
explicitly do it in code.
The code used by SparkContext to implement the feature was refactored into
a helper method in the Utils class, and SQL's ExecutionListenerManager was
modified to use it to initialize listener declared in the configuration.
Unit tests were added to verify all the new functionality.
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
