mustafasrepo commented on PR #9346: URL: https://github.com/apache/arrow-datafusion/pull/9346#issuecomment-1968332988
> No further comments from me, aside from thanks once again @mustafasrepo for handling this! > > Perhaps just a side note that even `RUST_MIN_STACK=300000` is insufficient for the original source of the issue now (`tpcds_physical_q64`), and seems to need a couple of orders more. Not sure whether #8837 is still active, but definitely worth tracking somewhere, and eventually un-ignoring the test. @metesynnada did some debugging of `tpcds_physical_q64` why stack overflow occurs. It seems that overflow occurs in `create_intial_plan` stage of planner (It is the place, where `LogicalPlan` is converted to the `PhysicalPlan`. Not during any physical rule or logical plan creation). Examining code structure, it seems that `recursive` futures are used by constructed `create_initial_plan` recursively on the `LogicalPlan`. I am not familiar with its implications, However the problem might be related to this behavior. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@arrow.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
