GitHub user gengliangwang opened a pull request:

    https://github.com/apache/spark/pull/20769

    [SPARK-23624][SQL]Revise doc of method pushFilters in Datasource V2

    ## What changes were proposed in this pull request?
    
    Revise doc of method pushFilters in 
SupportsPushDownFilters/SupportsPushDownCatalystFilters
    
    In `FileSourceStrategy`, except `partitionKeyFilters`(the references of 
which is subset of partition keys), all filters needs to be evaluated after 
scanning. Otherwise, Spark will get wrong result from data sources like 
Orc/Parquet.
    
    This PR is to improve the doc.
    


You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/gengliangwang/spark revise_pushdown_doc

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/spark/pull/20769.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #20769
    
----
commit bc98b206aefc6663884ad0e5f6052ac214094180
Author: Wang Gengliang <gengliang.wang@...>
Date:   2018-03-08T04:20:02Z

    Update doc for SupportsPushDownCatalystFilters and SupportsPushDownFilters

----


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

Reply via email to