Juliet Hougland created SPARK-8642:
--------------------------------------
Summary: Ungraceful failure when yarn client is not configured.
Key: SPARK-8642
URL: https://issues.apache.org/jira/browse/SPARK-8642
Project: Spark
Issue Type: Bug
Components: YARN
Affects Versions: 1.3.1, 1.3.0
Reporter: Juliet Hougland
Priority: Minor
When HADOOP_CONF_DIR is not configured (ie yarn-site.xml is not available) the
yarn client will try to submit an application. No connection to the resource
manager will be able to be established. The client will try to connect 10 times
(with a max retry of ten), and then do that 30 more time. This takes about 5
minutes before an Error is recorded for spark context initialization, which is
caused by a connect exception. I would expect that after the first 1- tries
fail, the initialization of the spark context should fail too. At least that is
what I would think given the logs. An earlier failure would be ideal/preferred.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
