It is really a good idea to build a docker container for spark.
Yours, Xuefeng Wu 吴雪峰 敬上 > On 2014年1月14日, at 上午12:10, Aureliano Buendia <[email protected]> wrote: > > Why not using docker for spark? GCE recently supports custom kernels allowing > docker to work on it. > > A docket image can be shared between GCE and EC2. > > >> On Mon, Jan 13, 2014 at 8:56 AM, Mayur Rustagi <[email protected]> >> wrote: >> Hi, >> I have setup a basic guide here. >> >> http://docs.sigmoidanalytics.com/index.php/How_to_Install_Spark_on_Google_Compute_Engine >> >> GCE unfortunately doesnt provide a easy way to manage images( It has >> interface to download the tar.gz image and then reload it, I didnt find it >> as convinient as AMI). If you create one let me know and I'll update the >> guide accordingly. If you create a sharable image let me know i'll host it >> on S3 and make it available for all. >> >> Regards >> Mayur >> >> >> Mayur Rustagi >> Ph: +919632149971 >> http://www.sigmoidanalytics.com >> https://twitter.com/mayur_rustagi >> >> >> >>> On Mon, Jan 13, 2014 at 11:01 AM, Debasish Das <[email protected]> >>> wrote: >>> Hi Aureliano, >>> >>> Look for google compute engine scripts from typesafe repo. They recently >>> tested Akka Cluster on 2400 nodes from Google Compute Engine. You should be >>> able to reuse the scripts. >>> >>> Thanks. >>> Deb >>> >>> >>>> On Sun, Jan 12, 2014 at 8:00 PM, Aureliano Buendia <[email protected]> >>>> wrote: >>>> Hi, >>>> >>>> Has anyone worked on a script similar to spark-ec2 for google compute >>>> engine? >>>> >>>> Google compute engine claims that they have faster instance start up time, >>>> and that together with by minute charging makes it a desirable choice for >>>> spark. >
