Dandandan opened a new issue, #3528: URL: https://github.com/apache/arrow-datafusion/issues/3528
**Is your feature request related to a problem or challenge? Please describe what you are trying to do.** We can use the availability of a `Limit` to speed up sorts in DataFusion: **Describe the solution you'd like** We can start utilizing the limit in different places: * lexsort_to_indices supports a limit argument - this argument can be filled * a `LocalLimit` can be added before SortPreservingMergeExec (after https://github.com/apache/arrow-datafusion/pull/3527), limiting the input for this * Probably `SortPreservingMergeStream` can start utilizing optional limits too - only merging the first n sorted rows for each batch. **Describe alternatives you've considered** A clear and concise description of any alternative solutions or features you've considered. **Additional context** Add any other context or screenshots about the feature request here. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
