caneGuy opened a new pull request #26503: [SPARK-29880][CORE] Handle submit exception when submit to federation cluster URL: https://github.com/apache/spark/pull/26503 When we submit application to federation yarn cluster. Since getYarnClusterMetrics is not implemented. The submission will exit with failure. `def submitApplication(): ApplicationId = { ResourceRequestHelper.validateResources(sparkConf) var appId: ApplicationId = null try { launcherBackend.connect() yarnClient.init(hadoopConf) yarnClient.start() logInfo("Requesting a new application from cluster with %d NodeManagers" .format(yarnClient.getYarnClusterMetrics.getNumNodeManagers))` ### Why are the changes needed? Since hadoop federation cluster was deployed, spark application will submit with failure if we do not handle the exception. ### How was this patch tested? UT
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
