That's not true in yarn-cluster mode, where the driver runs in a container that YARN creates, which may not be on the machine that runs spark-submit.
As far as I know, however, you can't control where YARN allocates that, and shouldn't need to. You can probably query YARN to find where it did end up running though. On Fri, Dec 19, 2014 at 5:44 AM, madhu phatak <phatak....@gmail.com> wrote: > Hi, > The driver runs on the machine from where you did the spark-submit. You > cannot change that. > > On Thu, Dec 18, 2014 at 3:44 PM, LinQili <lin_q...@outlook.com> wrote: >> >> Hi all, >> On yarn-cluster mode, can we let the driver running on a specific machine >> that we choose in cluster ? Or, even the machine not in the cluster? > > > > -- > Regards, > Madhukara Phatak > http://www.madhukaraphatak.com --------------------------------------------------------------------- To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
