Re: Launching EC2 instances with Spark compiled for Scala 2.11
Why not deploy it. Then build a custom distribution with Scala 2.11 and just overlay it. Sent from my Verizon Wireless 4G LTE smartphone Original message From: Nuno Santos Date: 01/25/2016 7:38 AM (GMT-05:00) To: user@spark.apache.org Subject: Re: Launching EC2 instances with Spark compiled for Scala 2.11 Hello, Any updates on this question? I'm also very interested in a solution, as I'm trying to use Spark on EC2 but need Scala 2.11 support. The scripts in the ec2 directory of the Spark distribution install use Scala 2.10 by default and I can't see any obvious option to change to Scala 2.11. Regards, Nuno -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Launching-EC2-instances-with-Spark-compiled-for-Scala-2-11-tp24979p26059.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
Re: Launching EC2 instances with Spark compiled for Scala 2.11
Hello, Any updates on this question? I'm also very interested in a solution, as I'm trying to use Spark on EC2 but need Scala 2.11 support. The scripts in the ec2 directory of the Spark distribution install use Scala 2.10 by default and I can't see any obvious option to change to Scala 2.11. Regards, Nuno -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Launching-EC2-instances-with-Spark-compiled-for-Scala-2-11-tp24979p26059.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
Re: Launching EC2 instances with Spark compiled for Scala 2.11
Is it possible for you to use EMR instead of EC2? If so, you may be able to tweak EMR bootstrap scripts to install your custom spark build. Thanks, Aniket On Thu, Oct 8, 2015 at 5:58 PM Theodore Vasiloudis < theodoros.vasilou...@gmail.com> wrote: > Hello, > > I was wondering if there is an easy way launch EC2 instances which have a > Spark built for Scala 2.11. > > The only way I can think of is to prepare the sources for 2.11 as shown in > the Spark build instructions ( > http://spark.apache.org/docs/latest/building-spark.html#building-for-scala-211), > upload the changed sources as a Github repo, and use the "--spark-git-repo" > option to specify the repo as the one to build from. > > Is there a recommended way to launch EC2 instances if you need Scala 2.11 > support? > > Regards, > Theodore > > -------------- > View this message in context: Launching EC2 instances with Spark compiled > for Scala 2.11 > <http://apache-spark-user-list.1001560.n3.nabble.com/Launching-EC2-instances-with-Spark-compiled-for-Scala-2-11-tp24979.html> > Sent from the Apache Spark User List mailing list archive > <http://apache-spark-user-list.1001560.n3.nabble.com/> at Nabble.com. >
Launching EC2 instances with Spark compiled for Scala 2.11
Hello, I was wondering if there is an easy way launch EC2 instances which have a Spark built for Scala 2.11. The only way I can think of is to prepare the sources for 2.11 as shown in the Spark build instructions ( http://spark.apache.org/docs/latest/building-spark.html#building-for-scala-211), upload the changed sources as a Github repo, and use the "--spark-git-repo" option to specify the repo as the one to build from. Is there a recommended way to launch EC2 instances if you need Scala 2.11 support? Regards, Theodore -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Launching-EC2-instances-with-Spark-compiled-for-Scala-2-11-tp24979.html Sent from the Apache Spark User List mailing list archive at Nabble.com.
