pmcgleenon commented on issue #17721: URL: https://github.com/apache/datafusion/issues/17721#issuecomment-3503474861
quick update on this, after enabling the configuration mentioned in the [blog](https://datafusion.apache.org/blog/2025/09/10/dynamic-filters/) there is an improvement for Q23 from 9s to 0.8 ``` export DATAFUSION_EXECUTION_PARQUET_REORDER_FILTERS='true'; export DATAFUSION_OPTIMIZER_ENABLE_DYNAMIC_FILTER_PUSHDOWN='true'; export DATAFUSION_EXECUTION_PARQUET_PUSHDOWN_FILTERS='true'; # datafusion-cli -f create.sql q23.sql 2>^1 | grep "Elapsed" |sed -n 2p | awk '{ print $2 }' 0.801 # datafusion-cli -f create.sql q23.sql 2>^1 | grep "Elapsed" |sed -n 2p | awk '{ print $2 }' 0.798 # datafusion-cli -f create.sql q23.sql 2>^1 | grep "Elapsed" |sed -n 2p | awk '{ print $2 }' 0.814 # datafusion-cli -f create.sql q23.sql 2>^1 | grep "Elapsed" |sed -n 2p | awk '{ print $2 }' 0.819 ``` Is this configuration we'd want to enable by default? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
