adriangb commented on PR #15591:
URL: https://github.com/apache/datafusion/pull/15591#issuecomment-2910963654
> Part of the better aggregation spilling (I will file a issue to discuss
it maybe tonight)
Without having a full understanding of this PR (I have just been following
the conversation because the change is exciting) my 2ยข is: for us memory
management is currently one of the biggest thorns with DataFusion. It is quite
hard at the moment to run with a fixed memory budget given the mix of exceeding
memory through under accounting and refusing to run operators that can't spill
/ try to claim more memory than they actually use.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
