metesynnada commented on code in PR #5322:
URL: https://github.com/apache/arrow-datafusion/pull/5322#discussion_r1115291450
##########
datafusion/core/src/execution/context.rs:
##########
@@ -1528,6 +1528,9 @@ impl SessionState {
// repartitioning and local sorting steps to meet distribution and
ordering requirements.
// Therefore, it should run before EnforceDistribution and
EnforceSorting.
Arc::new(JoinSelection::new()),
+ // Enforce sort before PipelineFixer
Review Comment:
If the filter expression is incapable of pruning both sides, bounded sources
will not experience any performance boost since there is no sliding window
effect. We plan to include a check for whether the filter expression supports
range pruning on both sides in a future PR. Once this check is in place, we can
evaluate the feasibility of applying this plan to bounded sources.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
