GitHub user sathiyapk opened a pull request:
https://github.com/apache/spark/pull/19295
SPARK-22080 Adds support for allowing user to add pre-optimization rules
## What changes were proposed in this pull request?
Currently the user provided custom rules are applied only after all the
spark's native rules are applied. The changes in this PR allows users to add
rules (pre-optimization rules) that will applied before spark's native rules
for Analyzer and Optimizer are applied .
## How was this patch tested?
The changes are unit tested and also locally test using spark shell.
Please review http://spark.apache.org/contributing.html before opening a
pull request.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/sathiyapk/spark
SPARK-22080-allow-preOptimization-rule
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/19295.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #19295
----
commit abd6c04240b11f54cff8db2fa1c509d25c275358
Author: sathiya <[email protected]>
Date: 2017-09-20T14:56:09Z
SPARK-22080 Adds support for allowing user to add pre-optimization rules
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
