Juliet Hougland created SPARK-8642: -------------------------------------- Summary: Ungraceful failure when yarn client is not configured. Key: SPARK-8642 URL: https://issues.apache.org/jira/browse/SPARK-8642 Project: Spark Issue Type: Bug Components: YARN Affects Versions: 1.3.1, 1.3.0 Reporter: Juliet Hougland Priority: Minor
When HADOOP_CONF_DIR is not configured (ie yarn-site.xml is not available) the yarn client will try to submit an application. No connection to the resource manager will be able to be established. The client will try to connect 10 times (with a max retry of ten), and then do that 30 more time. This takes about 5 minutes before an Error is recorded for spark context initialization, which is caused by a connect exception. I would expect that after the first 1- tries fail, the initialization of the spark context should fail too. At least that is what I would think given the logs. An earlier failure would be ideal/preferred. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org