alamb commented on PR #7180: URL: https://github.com/apache/arrow-datafusion/pull/7180#issuecomment-1673629789
FWIW I made a very simplistic POC for a special TopK operator and for my test (K=10) it goes almost 2x faster and uses 1/3 the peak memory. There is also plenty of room for both algorithmic and engineering optimizations. I'll be hacking on the idea in https://github.com/apache/arrow-datafusion/pull/7250 and will make a broader announcement when ready -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
