RE: yarn-client mode question
Thank you -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/yarn-client-mode-question-tp6213p6224.html Sent from the Apache Spark User List mailing list archive at Nabble.com.
RE: yarn-client mode question
Seems you are asking that does spark related jar need to be deploy to yarn cluster manually before you launch application? Then, no , you don't, just like other yarn application. And it doesn't matter it is yarn-client or yarn-cluster mode.. Best Regards, Raymond Liu -Original Message- From: Sophia [mailto:sln-1...@163.com] Sent: Thursday, May 22, 2014 10:55 AM To: u...@spark.incubator.apache.org Subject: Re: yarn-client mode question But,I don't understand this point,is it necessary to deploy slave node of spark in the yarn node? -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/yarn-client-mode-question-tp6213p6216.html Sent from the Apache Spark User List mailing list archive at Nabble.com.
Re: yarn-client mode question
But,I don't understand this point,is it necessary to deploy slave node of spark in the yarn node? -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/yarn-client-mode-question-tp6213p6216.html Sent from the Apache Spark User List mailing list archive at Nabble.com.
Re: yarn-client mode question
Hi Sophia, In yarn-client mode, the node that submits the application can either be inside or outside of the cluster. This node also hosts the driver (SparkContext) of the application. All the executors, however, will be launched on nodes inside the YARN cluster. Andrew 2014-05-21 18:17 GMT-07:00 Sophia : > As the yarn-client mode,will spark be deployed in the node of yarn? If it > is > deployed only in the client,can spark submit the job to yarn? > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/yarn-client-mode-question-tp6213.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. >