I'm not an expert on YARN so anyone please correct me if I'm wrong, but I believe the Resource Manager will schedule the application to be run on the AM of any node that has a Node Manager, depending on available resources. So you would normally query the RM via the REST API to determine that. You can restrict which nodes get scheduled using this propery spark.yarn.am.nodeLabelExpression. See here for details http://spark.apache.org/docs/latest/running-on-yarn.html
On Mon, Jun 6, 2016 at 9:04 AM, Saiph Kappa <saiph.ka...@gmail.com> wrote: > How can I specify the node where application master should run in the yarn > conf? I haven't found any useful information regarding that. > > Thanks. > > On Mon, Jun 6, 2016 at 4:52 PM, Bryan Cutler <cutl...@gmail.com> wrote: > >> In that mode, it will run on the application master, whichever node that >> is as specified in your yarn conf. >> On Jun 5, 2016 4:54 PM, "Saiph Kappa" <saiph.ka...@gmail.com> wrote: >> >>> Hi, >>> >>> In yarn-cluster mode, is there any way to specify on which node I want >>> the driver to run? >>> >>> Thanks. >>> >> >
