Hi Ajay, You don't need to copy tarball to all the nodes, only one node you want to run spark application is enough (mostly the master node), Yarn will help to distribute the Spark dependencies. The link I mentioned before is the one you could follow, please read my previous mail.
Thanks Saisai On Thu, Oct 22, 2015 at 1:56 AM, Ajay Chander <itsche...@gmail.com> wrote: > Thanks for your kind inputs. Right now I am running spark-1.3.1 on YARN(4 > node cluster) on a HortonWorks distribution. Now I want to upgrade > spark-1.3.1 to > spark-1.5.1. So at this point of time, do I have to manually go and copy > spark-1.5.1 tarbal to all the nodes or is there any alternative so that I > can get it upgraded through Ambari UI ? If possible can anyone point me to > a documentation online? Thank you. > > Regards, > Ajay > > > On Wednesday, October 21, 2015, Saisai Shao <sai.sai.s...@gmail.com> > wrote: > >> Hi Frans, >> >> You could download Spark 1.5.1-hadoop 2.6 pre-built tarball and copy into >> HDP 2.3 sandbox or master node. Then copy all the conf files from >> /usr/hdp/current/spark-client/ to your <spark-1.5.1>/conf, or you could >> refer to this tech preview ( >> http://hortonworks.com/hadoop-tutorial/apache-spark-1-4-1-technical-preview-with-hdp/ >> ), in "installing chapter", step 4 ~ 8 is what you need to do. >> >> Thanks >> Saisai >> >> On Wed, Oct 21, 2015 at 1:27 PM, Frans Thamura <fr...@meruvian.org> >> wrote: >> >>> Doug >>> >>> is it possible to put in HDP 2.3? >>> >>> esp in Sandbox >>> >>> can share how do you install it? >>> >>> >>> F >>> -- >>> Frans Thamura (曽志胜) >>> Java Champion >>> Shadow Master and Lead Investor >>> Meruvian. >>> Integrated Hypermedia Java Solution Provider. >>> >>> Mobile: +628557888699 >>> Blog: http://blogs.mervpolis.com/roller/flatburger (id) >>> >>> FB: http://www.facebook.com/meruvian >>> TW: http://www.twitter.com/meruvian / @meruvian >>> Website: http://www.meruvian.org >>> >>> "We grow because we share the same belief." >>> >>> >>> On Wed, Oct 21, 2015 at 12:24 PM, Doug Balog <doug.sparku...@dugos.com> >>> wrote: >>> > I have been running 1.5.1 with Hive in secure mode on HDP 2.2.4 >>> without any problems. >>> > >>> > Doug >>> > >>> >> On Oct 21, 2015, at 12:05 AM, Ajay Chander <itsche...@gmail.com> >>> wrote: >>> >> >>> >> Hi Everyone, >>> >> >>> >> Any one has any idea if spark-1.5.1 is available as a service on >>> HortonWorks ? I have spark-1.3.1 installed on the Cluster and it is a >>> HortonWorks distribution. Now I want upgrade it to spark-1.5.1. Anyone here >>> have any idea about it? Thank you in advance. >>> >> >>> >> Regards, >>> >> Ajay >>> > >>> > >>> > --------------------------------------------------------------------- >>> > To unsubscribe, e-mail: user-unsubscr...@spark.apache.org >>> > For additional commands, e-mail: user-h...@spark.apache.org >>> > >>> >>> --------------------------------------------------------------------- >>> To unsubscribe, e-mail: user-unsubscr...@spark.apache.org >>> For additional commands, e-mail: user-h...@spark.apache.org >>> >>> >>
