Dear PJ$,
If you are familiar with Puppet, you could try using the puppet module I wrote
(currently for Spark 0.9.0, I custom compiled it since no Debian package was
available at the time I started with a project I required it for).
https://github.com/stefanvanwouw/puppet-spark
---
Kind regard
Ha yes,,, I just went through this.
(a) You have to use the ;'default' spark AMI, ( ami-7a320f3f at the moment
) and not any of the other linux distros. They don't work.
(b) Start with m1.large instances.. I tried going for r3.large at first,
and had no end of self-caused trouble. m1.large works.
So to run spark-ec2, you should use the default AMI that it launches with if
you don’t pass -a. Those are based on Amazon Linux, not Debian. Passing your
own AMI is an advanced option but people need to install some stuff on their
AMI in advance for it to work with our scripts.
Matei
On Jun 1
Running on a few m3.larges with the ami-848a6eec image (debian 7). Haven't
gotten any further. No clue what's wrong. I'd really appreciate any
guidance y'all could offer.
Best,
PJ$
On Sat, May 31, 2014 at 1:40 PM, Matei Zaharia
wrote:
> What instance types did you launch on?
>
> Sometimes you
What instance types did you launch on?
Sometimes you also get a bad individual machine from EC2. It might help to
remove the node it’s complaining about from the conf/slaves file.
Matei
On May 30, 2014, at 11:18 AM, PJ$ wrote:
> Hey Folks,
>
> I'm really having quite a bit of trouble gettin
Hey Folks,
I'm really having quite a bit of trouble getting spark running on ec2. I'm
not using scripts the https://github.com/apache/spark/tree/master/ec2
because I'd like to know how everything works. But I'm going a little
crazy. I think that something about the networking configuration must be
