ulysses-you commented on pull request #35856: URL: https://github.com/apache/spark/pull/35856#issuecomment-1070315010
hi @linhongliu-db , thank you for the feature ! I wonder, if is it possible to give a more accuracy time of the plan changes. In particular, the phase of re-optimize and the query stage optimization in AQE. The `updatedTime` itself can only be used with previous stage finished time together which is quite limited, otherwise it is less meaning. We have encountered some performance issues, like SPARK-38406, SPARK-38401. I see the scope may be out of this pr. It would be very helpful if we can show more details. And as you have mentioned, It is friendly if we can also put some summary into UI. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
