advancedxy commented on PR #42195: URL: https://github.com/apache/spark/pull/42195#issuecomment-1656590671
> That's a pretty extreme scenario to try to work around. I'm concerned that this change isn't enough; in such a case I bet N other things fail. Are you sure this hack is enough? Yeah, it's pretty extreme. A lot of things fails, for example, the `SparkFatalException` loading is failed too in such case. However after this fix, the executor JVM at least has a chance to halt or exit theoretically. > Is there any other way to load the class like a local import? Tried for locally import, it wouldn't load class eagerly. See javap output below <img width="1196" alt="image" src="https://github.com/apache/spark/assets/807537/96e4db1e-d194-422c-80ac-30f49b06785b";> The javap output for current impl: <img width="1149" alt="image" src="https://github.com/apache/spark/assets/807537/cc69a44f-8295-44ee-b837-b78d745d5e17";> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
