mattgerg12 opened a new issue #12568: URL: https://github.com/apache/arrow/issues/12568
@nealrichardson Does arrow R query optimizer can automatically push down filters and projections based on the `dplyr` transformation queries that follows after the load using `open_dataset()`? I am aware that if we give the `partitioning =`option then it will only put the directories that is needed. But other than this are there any options to achieve the predicate and projection pushdown ? Are there any plans to support this in future ? Or the recent integration with [duckDB](https://arrow.apache.org/docs/r/news/#2-duckdb-integration-6-0-0) is the solution Rarrow is leaning towards? But in this situation we are limited in using only duckDB verbs. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
