zhuqi-lucas commented on PR #23420: URL: https://github.com/apache/datafusion/pull/23420#issuecomment-4935886290
One known corner case worth flagging: `SELECT narrow WHERE ... ORDER BY sort_col LIMIT N`. At `try_pushdown_filters` time the sort/TopK signal isn't set yet, so the gate can't see "TopK is coming" and declines the WHERE — which then blocks the dynamic RG-prune cascade from #22450. The new config knob (`pushdown_filter_narrow_projection_gate = false`) is the escape hatch for those users. Documented in the upgrade guide. Given the ClickBench trade (5F/4S/34NC vs 6F/20S/17NC), I think shipping as-is + opt-out is the pragmatic call. LMK if you'd rather defer. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
