Re: EC2 clusters ready in launch time + 30 seconds

2014-11-08 Thread Nicholas Chammas
] Sent: Thursday, October 02, 2014 4:44 PM To: Nicholas Chammas Cc: dev; Shivaram Venkataraman Subject: Re: EC2 clusters ready in launch time + 30 seconds I think this is exactly what packer is for. See e.g. http://www.packer.io/intro/getting-started/build-image.html

Re: EC2 clusters ready in launch time + 30 seconds

2014-10-06 Thread Daniil Osipov
02, 2014 4:44 PM To: Nicholas Chammas Cc: dev; Shivaram Venkataraman Subject: Re: EC2 clusters ready in launch time + 30 seconds I think this is exactly what packer is for. See e.g. http://www.packer.io/intro/getting-started/build-image.html On a related note, the current AMI

Re: EC2 clusters ready in launch time + 30 seconds

2014-10-06 Thread Nicholas Chammas
: dev; Shivaram Venkataraman Subject: Re: EC2 clusters ready in launch time + 30 seconds I think this is exactly what packer is for. See e.g. http://www.packer.io/intro/getting-started/build-image.html On a related note, the current AMI for hvm systems (e.g. m3.*, r3.*) has a bad

Re: EC2 clusters ready in launch time + 30 seconds

2014-10-06 Thread David Rowe
: Re: EC2 clusters ready in launch time + 30 seconds I think this is exactly what packer is for. See e.g. http://www.packer.io/intro/getting-started/build-image.html On a related note, the current AMI for hvm systems (e.g. m3.*, r3.*) has a bad package for httpd, whcih

Re: EC2 clusters ready in launch time + 30 seconds

2014-10-04 Thread Patrick Wendell
Venkataraman Subject: Re: EC2 clusters ready in launch time + 30 seconds I think this is exactly what packer is for. See e.g. http://www.packer.io/intro/getting-started/build-image.html On a related note, the current AMI for hvm systems (e.g. m3.*, r3.*) has a bad package for httpd, whcih causes

Re: EC2 clusters ready in launch time + 30 seconds

2014-10-04 Thread Nicholas Chammas
...@gmail.com] Sent: Thursday, October 02, 2014 4:44 PM To: Nicholas Chammas Cc: dev; Shivaram Venkataraman Subject: Re: EC2 clusters ready in launch time + 30 seconds I think this is exactly what packer is for. See e.g. http://www.packer.io/intro/getting-started/build-image.html

Re: EC2 clusters ready in launch time + 30 seconds

2014-10-03 Thread Nicholas Chammas
: dev; Shivaram Venkataraman Subject: Re: EC2 clusters ready in launch time + 30 seconds I think this is exactly what packer is for. See e.g. http://www.packer.io/intro/getting-started/build-image.html On a related note, the current AMI for hvm systems (e.g. m3.*, r3.*) has a bad package

Re: EC2 clusters ready in launch time + 30 seconds

2014-10-02 Thread Nicholas Chammas
Nate -Original Message- From: David Rowe [mailto:davidr...@gmail.com] Sent: Thursday, October 02, 2014 4:44 PM To: Nicholas Chammas Cc: dev; Shivaram Venkataraman Subject: Re: EC2 clusters ready in launch time + 30 seconds I think this is exactly what packer is for. See e.g. http

Re: EC2 clusters ready in launch time + 30 seconds

2014-07-13 Thread Shivaram Venkataraman
It should be possible to improve cluster launch time if we are careful about what commands we run during setup. One way to do this would be to walk down the list of things we do for cluster initialization and see if there is anything we can do make things faster. Unfortunately this might be pretty

Re: EC2 clusters ready in launch time + 30 seconds

2014-07-12 Thread Nicholas Chammas
On Thu, Jul 10, 2014 at 8:10 PM, Nate D'Amico n...@reactor8.com wrote: Starting to work through some automation/config stuff for spark stack on EC2 with a project, will be focusing the work through the apache bigtop effort to start, can then share with spark community directly as things

EC2 clusters ready in launch time + 30 seconds

2014-07-10 Thread Nicholas Chammas
Hi devs! Right now it takes a non-trivial amount of time to launch EC2 clusters. Part of this time is spent starting the EC2 instances, which is out of our control. Another part of this time is spent installing stuff on and configuring the instances. This, we can control. I’d like to explore

RE: EC2 clusters ready in launch time + 30 seconds

2014-07-10 Thread Nate D'Amico
-Original Message- From: Nicholas Chammas [mailto:nicholas.cham...@gmail.com] Sent: Thursday, July 10, 2014 3:06 PM To: dev Subject: EC2 clusters ready in launch time + 30 seconds Hi devs! Right now it takes a non-trivial amount of time to launch EC2 clusters. Part of this time is spent