Rachelint commented on PR #15591: URL: https://github.com/apache/datafusion/pull/15591#issuecomment-2890524255
> Will do Thanks! > No worries -- I am sorry I have not given it as much attention as I would like. Is there anything else I can do to help (like implement one of the grouped memory examples)? I am about to file a ticket to start organizing the follow on work I think still need some time to evaluate what benefits can this brings After experiment, I found: - It can really help to reduce memory usage as @joroKr21 mentioned in #9562 - But it maybe not really help much for performance (performance improve mainly due to removal of usage of expansive `slice`) currently. But inspired by the `batch_size` based memory allocation, I am thinking can we have some ways to reuse memory? And I am trying it today. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For additional commands, e-mail: github-h...@datafusion.apache.org
