Cheng Lian created SPARK-9557:
---------------------------------

             Summary: Refactor ParquetFilterSuite and remove old ParquetFilters 
code
                 Key: SPARK-9557
                 URL: https://issues.apache.org/jira/browse/SPARK-9557
             Project: Spark
          Issue Type: Test
          Components: SQL
    Affects Versions: 1.5.0
            Reporter: Cheng Lian
            Assignee: Cheng Lian


Currently there are two Parquet filter conversion code path, one for converting 
data sources {{Filter}}, the other for converting Catalyst predicate 
{{Expression}}, which is used by the removed old Parquet code. We should remove 
the latter, but {{ParquetFilterSuite}} uses it to test Parquet filter push-down.

Need to refactor {{ParquetFilterSuite}} to make it test the data source version 
and then remove the old Parquet filter conversion code.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to