rluvaton commented on issue #16904: URL: https://github.com/apache/datafusion/issues/16904#issuecomment-3193801681
> Specifically I think [@rluvaton](https://github.com/rluvaton) is requesting something that is already possible with TrackConsumersPool -- and if that is the case, then we could potentially resolve the ticket by adding some more docs / examples to the TrackConsumersPool. nope, this is a new functionality. like in the case of: - #17169 I want when memory failed and by some API that I can call it will print not only all the consumers but the consumers size breakdown. for: ``` Resources exhausted: Failed to allocate additional 55.0 MB for GroupedHashAggregateStream[3] ``` (for simplicity of the example let's say `GroupedHashAggregateStream` is the only thing that consume memory, and single partition, I want to have for consumer) I want to get something like: ``` GroupedHashAggregateStream[3]: accumulators: total size <> accumulator[1] <name>: <size> accumulator[2] <name>: <size> group_values: <size> group_ordering: <size> current_group_indices: <size> ``` as this is the code that calculate the size in row_hash: https://github.com/apache/datafusion/blob/8f15991f33bf6aca9d4da8958141b59d196b2ed6/datafusion/physical-plan/src/aggregates/row_hash.rs#L916C9-L922C1 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For additional commands, e-mail: github-h...@datafusion.apache.org
