2010YOUY01 commented on issue #14692: URL: https://github.com/apache/datafusion/issues/14692#issuecomment-2771604094
> > This is a reproducer for an external sort query failure under a very low memory limit [#15028](https://github.com/apache/datafusion/issues/15028) Discord discussion:[discord.com/channels/885562378132000778/1346514274734051412](https://discord.com/channels/885562378132000778/1346514274734051412) I think this reproducer is only possible to get executed after implementing multi-pass merge, if wd don't set the memory limit higher. > > Can some provide a instruction for me to reproduce it and let me know which part of the code has the external sort algorithm? I can take a look at it. If there is any trouble reproducing, you can ask in the bug-tracking issue. > I probably can help if implementing a multi-pass external sort is the need, I've implemented multi-pass external sort before in python (just for fun). I hope it wouldn't be too hard to extend from current one-pass algorithm. Thank you. Just a heads-up, I think this issue is a bit tricky, we have to also look into the performance after implementing the algorithm. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For additional commands, e-mail: github-h...@datafusion.apache.org
