zanmato1984 opened a new issue, #41334: URL: https://github.com/apache/arrow/issues/41334
### Describe the enhancement requested Currently the size of Acero's temp stack is hardcoded in source: https://github.com/apache/arrow/blob/25bb627519f17835cb0b6ff95588f2de0cbaf7ad/cpp/src/arrow/acero/query_context.cc#L56 We've observed issues of hang/crash caused by this stack overflow, to name two: #39582, #39951 . And the hardcoded stack size has been once bumped, along with a more explicit stack overflow error, to solve them: #40007. But as long as the stack size is still hardcoded (and not insanely big), it won't be surprising if the overflow happens again for a more complex plan. And once that happened, one wouldn't be able to mitigate this issue without patching the source code (with a bigger stack size) and building the binary from scratch. I think an env var might be well suitable to tune this stack size at runtime, to help the user quick mitigate the overflow. ### Component(s) C++ -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
