zhengruifeng commented on pull request #34602: URL: https://github.com/apache/spark/pull/34602#issuecomment-994467356
This should be a regression, but a simple change `if (shuffleStages.length == 2)` -> `if (shuffleStages.length >= 2)` should be enough to fix it. (I test `AdaptiveQueryExecSuite` and the added two cases in this PR, it is ok) As to https://github.com/apache/spark/pull/33893, I also update it to support this case. It supports multi joins with union/agg/win nodes in single stage, and had been used on our production system for 3 months, you may have a try. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
