RE: Is there a way to force spark to use specific ips?

2014-12-07 Thread Ashic Mahtab
to force spark to use specific ips? From: matt.narr...@gmail.com Date: Sat, 6 Dec 2014 16:34:13 -0700 CC: user@spark.apache.org To: as...@live.com Its much easier if you access your nodes by name. If you’re using Vagrant, use the hosts provisioner: https://github.com/adrienthebo/vagrant-hosts mn

Is there a way to force spark to use specific ips?

2014-12-06 Thread Ashic Mahtab
Hi,It appears that spark is always attempting to use the driver's hostname to connect / broadcast. This is usually fine, except when the cluster doesn't have DNS configured. For example, in a vagrant cluster with a private network. The workers and masters, and the host (where the driver runs