Re: Spark 1.4 on HortonWork HDP 2.2
I think you can get spark 1.4 pre built with hadoop 2.6 (as that what hdp 2.2 provides) and just start using it On Fri, Jun 19, 2015 at 10:28 PM, Ashish Soni asoni.le...@gmail.com wrote: I do not where to start as Spark 1.2 comes bundled with HDP2.2 but i want to use 1.4 and i do not know how to update it to 1.4 Ashish On Fri, Jun 19, 2015 at 8:26 AM, ayan guha guha.a...@gmail.com wrote: what problem are you facing? are you trying to build it yurself or gettingpre-built version? On Fri, Jun 19, 2015 at 10:22 PM, Ashish Soni asoni.le...@gmail.com wrote: Hi , Is any one able to install Spark 1.4 on HDP 2.2 , Please let me know how can i do the same ? Ashish -- Best Regards, Ayan Guha -- Best Regards, Ayan Guha
Re: Spark 1.4 on HortonWork HDP 2.2
what problem are you facing? are you trying to build it yurself or gettingpre-built version? On Fri, Jun 19, 2015 at 10:22 PM, Ashish Soni asoni.le...@gmail.com wrote: Hi , Is any one able to install Spark 1.4 on HDP 2.2 , Please let me know how can i do the same ? Ashish -- Best Regards, Ayan Guha
Spark 1.4 on HortonWork HDP 2.2
Hi , Is any one able to install Spark 1.4 on HDP 2.2 , Please let me know how can i do the same ? Ashish
Re: Spark 1.4 on HortonWork HDP 2.2
I do not where to start as Spark 1.2 comes bundled with HDP2.2 but i want to use 1.4 and i do not know how to update it to 1.4 Ashish On Fri, Jun 19, 2015 at 8:26 AM, ayan guha guha.a...@gmail.com wrote: what problem are you facing? are you trying to build it yurself or gettingpre-built version? On Fri, Jun 19, 2015 at 10:22 PM, Ashish Soni asoni.le...@gmail.com wrote: Hi , Is any one able to install Spark 1.4 on HDP 2.2 , Please let me know how can i do the same ? Ashish -- Best Regards, Ayan Guha
Re: Spark 1.4 on HortonWork HDP 2.2
If you run Hadoop in secure mode and want to talk to Hive 0.14, it won’t work, see SPARK-5111 I have a patched version of 1.3.1 that I’ve been using. I haven’t had the time to get 1.4.0 working. Cheers, Doug On Jun 19, 2015, at 8:39 AM, ayan guha guha.a...@gmail.com wrote: I think you can get spark 1.4 pre built with hadoop 2.6 (as that what hdp 2.2 provides) and just start using it On Fri, Jun 19, 2015 at 10:28 PM, Ashish Soni asoni.le...@gmail.com wrote: I do not where to start as Spark 1.2 comes bundled with HDP2.2 but i want to use 1.4 and i do not know how to update it to 1.4 Ashish On Fri, Jun 19, 2015 at 8:26 AM, ayan guha guha.a...@gmail.com wrote: what problem are you facing? are you trying to build it yurself or gettingpre-built version? On Fri, Jun 19, 2015 at 10:22 PM, Ashish Soni asoni.le...@gmail.com wrote: Hi , Is any one able to install Spark 1.4 on HDP 2.2 , Please let me know how can i do the same ? Ashish -- Best Regards, Ayan Guha -- Best Regards, Ayan Guha - To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
Re: Spark 1.4 on HortonWork HDP 2.2
You can get HDP with at least 1.3.1 from Horton: http://hortonworks.com/hadoop-tutorial/using-apache-spark-technical-preview-with-hdp-2-2/ for your convenience from the dos: wget -nv http://public-repo-1.hortonworks.com/HDP/centos6/2.x/updates/2.2.4.4/hdp.repo -O /etc/yum.repos.d/HDP-TP.repo and then install: yum install spark_2_2_4_4_16-master On Fri, Jun 19, 2015 at 12:01 PM, Doug Balog doug.sparku...@dugos.com wrote: If you run Hadoop in secure mode and want to talk to Hive 0.14, it won’t work, see SPARK-5111 I have a patched version of 1.3.1 that I’ve been using. I haven’t had the time to get 1.4.0 working. Cheers, Doug On Jun 19, 2015, at 8:39 AM, ayan guha guha.a...@gmail.com wrote: I think you can get spark 1.4 pre built with hadoop 2.6 (as that what hdp 2.2 provides) and just start using it On Fri, Jun 19, 2015 at 10:28 PM, Ashish Soni asoni.le...@gmail.com wrote: I do not where to start as Spark 1.2 comes bundled with HDP2.2 but i want to use 1.4 and i do not know how to update it to 1.4 Ashish On Fri, Jun 19, 2015 at 8:26 AM, ayan guha guha.a...@gmail.com wrote: what problem are you facing? are you trying to build it yurself or gettingpre-built version? On Fri, Jun 19, 2015 at 10:22 PM, Ashish Soni asoni.le...@gmail.com wrote: Hi , Is any one able to install Spark 1.4 on HDP 2.2 , Please let me know how can i do the same ? Ashish -- Best Regards, Ayan Guha -- Best Regards, Ayan Guha - To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
