GitHub user bogdanrdc opened a pull request:

    https://github.com/apache/spark/pull/22205

    [SPARK-25212][SQL] Support Filter in ConvertToLocalRelation

    ## What changes were proposed in this pull request?
    Support Filter in ConvertToLocalRelation, similar to how Project works.
    Additionally, in Optimizer, run ConvertToLocalRelation earlier to simplify 
the plan. This is good for very short queries which often are queries on local 
relations.
    
    
    ## How was this patch tested?
    New test. Manual benchmark.

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/bogdanrdc/spark local-relation-filter

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/spark/pull/22205.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #22205
    
----
commit 2a1cd27d7f188b51429553718cac91d87d667bbd
Author: Bogdan Raducanu <bogdan@...>
Date:   2018-08-23T13:17:11Z

    optimization + test

commit 421ee20e27c6d1ba9384528c765690103f407d34
Author: Bogdan Raducanu <bogdan@...>
Date:   2018-08-23T15:07:18Z

    debug benchmark + early batch

----


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

Reply via email to