mattgerg12 commented on issue #12568: URL: https://github.com/apache/arrow/issues/12568#issuecomment-1059407707
Thanks @nealrichardson for replying. Sorry for the misunderstanding. Is this automatic filter and projection pushdown feature with `rarrow` and `dplyr` OR in general with `arrow` ? As I was thinking it's not from this [arrow article](https://arrow.apache.org/blog/2021/12/03/arrow-duckdb/) that says _"For the comparison with Pandas, note that DuckDB runs in parallel, while pandas only support single-threaded execution. Besides that, one should note that we are comparing automatic optimizations. DuckDB’s query optimizer can automatically push down filters and projections. This automatic optimization is not supported in pandas, but it is possible for users to manually perform some of these predicate and filter pushdowns by manually specifying them them in the read_parquet() call."_ -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
