qstommyshu commented on issue #14692: URL: https://github.com/apache/datafusion/issues/14692#issuecomment-2771022723
> This is a reproducer for an external sort query failure under a very low memory limit [#15028](https://github.com/apache/datafusion/issues/15028) Discord discussion:[discord.com/channels/885562378132000778/1346514274734051412](https://discord.com/channels/885562378132000778/1346514274734051412) I think this reproducer is only possible to get executed after implementing multi-pass merge, if wd don't set the memory limit higher. Can some provide a instruction for me to reproduce it and let me know which part of the code has the external sort algorithm? I can take a look at it. I probably can help if implementing a multi-pass external sort can help, I've implemented multi-pass external sort algorithm before in python (just for fun). I hope it wouldn't be too hard to extend from current one-pass algorithm. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For additional commands, e-mail: github-h...@datafusion.apache.org
