berkaysynnada commented on PR #14821: URL: https://github.com/apache/datafusion/pull/14821#issuecomment-2690277488
> @berkaysynnada -- once I merged in the latest main, a (nice ❤️ ) [test added by you](https://github.com/apache/datafusion/blob/f5b7affecd90e9be26289d869c4a542359cb98e3/datafusion/core/tests/physical_optimizer/enforce_sorting.rs#L2089) a few hours earlier started failing. Specifically, it was failing due to the removal of heterogeneous constant fields from the ordering requirements. Your test case is not failing on main since the SortExec is kept intact, instead of selectively recreated (if needed) from the output ordering requirements. See here for exactly how this happens: [#14821 (comment)](https://github.com/apache/datafusion/pull/14821#issuecomment-2686306852) > I took a look, but couldn't quite get the point you try to emphasize. Do you think that there is a problem in sort_pushdown or compute_properties of window operators? > As a result, I proposed a possible "fix" (more here: [#14821 (comment)](https://github.com/apache/datafusion/pull/14821#issuecomment-2686475105)) based upon my limited understanding of how constants (and if they are heterogeneous across partitions) should be handled when calculating the output ordering. But I'm not sure this is the proper fix. 🤔 I'll share my thoughts there > > I'm going to convert this PR back to a draft, and make a reproducer test case isolating how `output_ordering()` calculates based on heterogeneous constants. Then we can decide that behavior first (before re-considering this PR). 👍🏻 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For additional commands, e-mail: github-h...@datafusion.apache.org
