AngersZhuuuu edited a comment on issue #24909: [SPARK-28106][SQL] When Spark SQL use "add jar" , before add to SparkContext, check jar path exist first. URL: https://github.com/apache/spark/pull/24909#issuecomment-504735327 > Can't it be possible that the jar path isn't accessible at driver, but only at executors? Special case, some jar may be used only in executor, but seem's we can't check it in driver. For add jar , local file will be add to RPC's file server, then executor can get it. For remote file, we just make sure it exist ,then let executor to get it. That's enough. But if driver can reach but executor can't, that should be a ENV setting up problem
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
