jackwener commented on PR #4465: URL: https://github.com/apache/arrow-datafusion/pull/4465#issuecomment-1445279373
@ygf11 @alamb @liukun4515 PTAL. I resolve all problem in this PR. now this PR just add some extra projection. This projection is used for prune-column. We can see `Spark` plan to see the expected effect, like [spark tpch q2 plan](https://github.com/apache/spark/blob/master/sql/core/src/test/resources/tpch-plan-stability/q2/explain.txt), you can see there are projection above join or filter. Because these projection can make we just get columns that we use, prune-column will make `datafusion` use less memory! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
