juliuszsompolski commented on pull request #28963: URL: https://github.com/apache/spark/pull/28963#issuecomment-652382625
@LantaoJin changed it the other way around in https://github.com/apache/spark/pull/25960, to display the actual error in AQE, I think there are more cases where the more useful internal error gets obscured - e.g. when a task fails, you would get actual reason for failure from the root cause, as opposed to just a "Task failed 4 times" RuntimeException. We've been recently investigating another issue, where "SparkUpgradeException" would not be displayed by thriftserver, because it was going for the root cause. Maybe we should do it in general, but then whitelist a few cases that should go for the rootcause - AQE exception - Job/stage failed - ... ? ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
