That's not true in yarn-cluster mode, where the driver runs in a
container that YARN creates, which may not be on the machine that runs
spark-submit.
As far as I know, however, you can't control where YARN allocates
that, and shouldn't need to.
You can probably query YARN to find where it did end
Hi,
The driver runs on the machine from where you did the spark-submit. You
cannot change that.
On Thu, Dec 18, 2014 at 3:44 PM, LinQili wrote:
>
> Hi all,
> On yarn-cluster mode, can we let the driver running on a specific machine
> that we choose in cluster ? Or, even the machine not in the cl
Hi all,On yarn-cluster mode, can we let the driver running on a specific
machine that we choose in cluster ? Or, even the machine not in the cluster?
