yaooqinn commented on PR #43746: URL: https://github.com/apache/spark/pull/43746#issuecomment-1809634875
Hi @tgravescs > Oh I just realized you added this config I(Or our customer you mean) didn't add it, 20 failure is calculated by 10 max executors * 2 Hi @mridulm @tgravescs > If users changes a jar mid application, this is really bad IMHO. > spark is not tolerant to out of band changes to the artifacts (jars, etc) while it is running - this needs to be fixed at the application end, Let take Spark Thrift Server and Spark Connect as examples, `ADD JAR` is an end-user user operation and the artifacts can be changed by themselves. Starting and maintaining the Server is for system admins. If the jar issue occurs here, shall we give enough time for admins to detect the issue and then gracefully reboot it to reduce the impact on other concurrent users. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
