zanmato1984 commented on PR #41335: URL: https://github.com/apache/arrow/pull/41335#issuecomment-2085981064
> * It's somewhat odd that temp vectors are associated with a QueryContext; this means that [join nodes within a query](https://github.com/stenlarsson/arrow-test/blob/main/hang.py?rgh-link-date=2024-04-30T16%3A41%3A35Z) are sharing their statically allocated space. Since each join node guarantees that it only allocates minibatch-sized subsets of the temp stack, I think it makes more sense to move temp stacks from QueryContext to `SwissJoin`, allowing it to manage the memory it uses. Well this is exactly what I've been asking in a previous email thread [1] to dev group. The answer back then suggested the opposite though :( https://lists.apache.org/thread/mm9667vst0jmk127thhsywjr1hvb614h -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
