YoungRX opened a new issue, #35305:
URL: https://github.com/apache/arrow/issues/35305

   ### Describe the enhancement requested
   
   I am using version 8.0.0. And I use Scanner class to read Parquet files. 
   
   When I read datas about timestamp or string types, I use TimestampScalar or 
StringScalar as predicate value, less or greater functions in expressions.h to 
organize filter expressions. I add these expressions to the ScanOptions.filter.
   
   ```
   select timestamp_col, string_col from parquet_file;  -- query1
   select timestamp_col, string_col from parquet_file where timestamp_col < 
'2020-01-01';  -- query2
   select timestamp_col, string_col from parquet_file where string_col > 
'hello';  -- query3
   ```
   Although the query results are correct, queries 2 and 3 take longer than 
query 1.
   
   **This indicates that queries 2 and 3 scan all data into memory before 
filtering, rather than avoiding scanning unnecessary row groups  by predicate 
pushdown first.**
   
   I make sure that these queries filter some groups of rows in my parquet data 
by predicate  pushdown.
   
   And I also tested the int32 type, which is able to do predicate pushdown.
   
   So could you please support predicate pushdown for timestamp and string 
types in Parquet Scanner?And more, please support decimal, interval, date and 
other types.
   
   Or this is just not supported in version 8.0.0. Please tell me which Arrow 
version supports these types of predicate pushdown.
   
   
   ### Component(s)
   
   C++


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to