Re: spark multi-node cluster

2014-09-28 Thread codeoedoc
Figured this out... documented here and hope can help others: http://koobehub.wordpress.com/2014/09/29/spark-the-standalone-cluster-deployment/ On Sun, Sep 28, 2014 at 12:36 AM, codeoedoc wrote: > Hi guys, > > This is a spark fresh user... > > I'm trying to setup a spark cluster with multiple no

Re: spark multi-node cluster

2014-09-28 Thread codeoedoc
BTW, I'm using standalone deployment (The name standalone deployment for cluster, is kind of misleading... I think the doc needs to be updated. It's not really standalone, but plain spark only deployment) Thx, cody On Sun, Sep 28, 2014 at 12:36 AM, codeoedoc wrote: > Hi guys, > > This is a spa

spark multi-node cluster

2014-09-28 Thread codeoedoc
Hi guys, This is a spark fresh user... I'm trying to setup a spark cluster with multiple nodes, starting with 2. With one node, it is working fine. When I get a slave node, slave is able to register to the master node. However when I launch a spark shell, and when the executor is launched on the