This is how i used to do it: - Login to the ec2 cluster (master) - Make changes to the spark, and build it. - Stop the old installation of spark (sbin/stop-all.sh) - Copy old installation conf/* to modified version's conf/ - Rsync modified version to all slaves - do sbin/start-all.sh from the modified version.
You can also simply replace the assembly jar (on master and worker) with the newly build jar if the versions are all same. Thanks Best Regards On Tue, Apr 28, 2015 at 10:59 PM, Bo Fu <b...@uchicago.edu> wrote: > Hi experts, > > I have an issue. I added some timestamps in Spark source code and built it > using: > > mvn package -DskipTests > > I checked the new version in my own computer and it works. However, when I > ran spark on EC2, the spark code EC2 machines ran is the original version. > > Anyone knows how to deploy the changed spark source code into EC2? > Thx a lot > > > Bo Fu > --------------------------------------------------------------------- > To unsubscribe, e-mail: user-unsubscr...@spark.apache.org > For additional commands, e-mail: user-h...@spark.apache.org > >
