adamreeve opened a new pull request, #24546: URL: https://github.com/apache/datafusion/pull/24546
## Which issue does this PR close? Related to #15191 ## Rationale for this change Optimizes sorted reads by avoiding a merge when the inputs can simple be concatenated. ## What changes are included in this PR? * Add a new `ProgressiveEvalExec` plan, based on #10490, but with some modifications. * Add a new `ReorderPartitionsExec` plan, to allow reordering partitions when required to maintain a global order. * Add a new `SequenceSortedInputs` optimizer rule, that does the conversion from `SortPreservingMergeExec` to `ProgressiveEvalExec` when possible. ## Are these changes tested? Yes, new tests have been added. ## Are there any user-facing changes? Yes. This adds to the public API and adds new configuration options, but the new optimization isn't enabled by default and there are no breaking changes. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
