ozankabak commented on PR #7180: URL: https://github.com/apache/arrow-datafusion/pull/7180#issuecomment-1671330447
I think trying out the `TopK` operator idea is definitely worthwhile. I think we will need to be very careful with the implementation (e.g. the heap part) to get it to perform, but I have a feeling that we should be able to get decent performance if we get the implementation right. Even if it turns out we can't, I think that effort will result in some interesting learnings we should be able to leverage to optimize the LIMIT case via other approaches. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
