Hi! Our application is launched from remotely pc via spark-submit in yarn-cluster mode with Kerberos keytab and principals by this guide: https://spark.apache.org/docs/latest/running-on-yarn.htmll (I can describe more in detail if it is required.) The advantages of this approach are that I have my own version of the spark on any cluster.
Is it possible to automatically deploy Apache Ignite into a Hadoop YARN cluster without sftp/ssh only by running a bash-script with HADOOP_CONF_DIR/YARN_CONF_DIR configs, Also on this guide: https://apacheignite.readme.io/docs/yarn-deployment you need to set up IGNITE_NODE_COUNT. Why you can’t get number of nodes in the cluster from YarnClient? Best regards, Andrey Yatsuk.
