YoungRX opened a new issue, #35305: URL: https://github.com/apache/arrow/issues/35305
### Describe the enhancement requested I am using version 8.0.0. And I use Scanner class to read Parquet files. When I read datas about timestamp or string types, I use TimestampScalar or StringScalar as predicate value, less or greater functions in expressions.h to organize filter expressions. I add these expressions to the ScanOptions.filter. ``` select timestamp_col, string_col from parquet_file; -- query1 select timestamp_col, string_col from parquet_file where timestamp_col < '2020-01-01'; -- query2 select timestamp_col, string_col from parquet_file where string_col > 'hello'; -- query3 ``` Although the query results are correct, queries 2 and 3 take longer than query 1. **This indicates that queries 2 and 3 scan all data into memory before filtering, rather than avoiding scanning unnecessary row groups by predicate pushdown first.** I make sure that these queries filter some groups of rows in my parquet data by predicate pushdown. And I also tested the int32 type, which is able to do predicate pushdown. So could you please support predicate pushdown for timestamp and string types in Parquet Scanner?And more, please support decimal, interval, date and other types. Or this is just not supported in version 8.0.0. Please tell me which Arrow version supports these types of predicate pushdown. ### Component(s) C++ -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
