xudong963 commented on code in PR #18090: URL: https://github.com/apache/datafusion/pull/18090#discussion_r2434638575
##########
docs/source/user-guide/configs.md:
##########
@@ -132,7 +132,9 @@ The following configuration settings are available:
| datafusion.optimizer.enable_round_robin_repartition |
true | When set to true, the physical plan optimizer will
try to add round robin repartitioning to increase parallelism to leverage more
CPU cores
|
| datafusion.optimizer.enable_topk_aggregation |
true | When set to true, the optimizer will attempt to
perform limit operations during aggregations, if possible
|
| datafusion.optimizer.enable_window_limits |
true | When set to true, the optimizer will attempt to
push limit operations past window functions, if possible
|
-| datafusion.optimizer.enable_dynamic_filter_pushdown |
true | When set to true attempts to push down dynamic
filters generated by operators into the file scan phase. For example, for a
query such as `SELECT * FROM t ORDER BY timestamp DESC LIMIT 10`, the optimizer
will attempt to push down the current top 10 timestamps that the TopK operator
references into the file scans. This means that if we already have 10
timestamps in the year 2025 any files that only have timestamps in the year
2024 can be skipped / pruned at various stages in the scan.
|
+| datafusion.optimizer.enable_topk_dynamic_filter_pushdown |
true | When set to true, the optimizer will attempt to
push down TopK dynamic filters into the file scan phase.
|
Review Comment:
done
https://github.com/apache/datafusion/pull/18090/commits/1cea3bff061267d71cd614f613ef21dd0ed72e9f
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
