wiedld opened a new pull request, #11665: URL: https://github.com/apache/datafusion/pull/11665
## Which issue does this PR close? Part of #11523 ## Rationale for this change The OOMing error message returns only the errors which occurred for the next incremental request of memory, and not for the biggest consumers of memory. As a result, we have spent time chasing OOMs in the wrong place. ## What changes are included in this PR? Includes a new MemoryPool implementation, which when (optionally) used with an inner Memorypool will return a list of the top memory consumers on err. This new `TrackConsumersPool` is optional, such that individual users can determine whether or not to use this capability (along with any associated overhead). ## Are these changes tested? Yes. ## Are there any user-facing changes? Yes, as a new `TrackConsumersPool`. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For additional commands, e-mail: github-h...@datafusion.apache.org
