GitHub user HeartSaVioR opened a pull request:
https://github.com/apache/spark/pull/21388
[SPARK-24336][SQL] Support 'pass through' transformation in BasicOperators
## What changes were proposed in this pull request?
Enable 'pass through' transformation in BasicOperators via reflection, so
that every pairs of transformation which only requires converting LogicalPlan
to SparkPlan via calling `planLater()` can be transformed automatically. It
just needs to add the pair of transformation in map.
## How was this patch tested?
Unit tests on existing tests.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/HeartSaVioR/spark SPARK-24336
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/21388.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #21388
----
commit 4c2f700a5d7944c13681581df7379e9653c5d588
Author: Jungtaek Lim <kabhwan@...>
Date: 2018-05-21T23:31:26Z
SPARK-24336 Support 'pass through' transformation in BasicOperators
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
