Re: Spark 1.4 on HortonWork HDP 2.2

2015-06-19 Thread ayan guha
I think you can get spark 1.4 pre built with hadoop 2.6 (as that what hdp 2.2 provides) and just start using it On Fri, Jun 19, 2015 at 10:28 PM, Ashish Soni asoni.le...@gmail.com wrote: I do not where to start as Spark 1.2 comes bundled with HDP2.2 but i want to use 1.4 and i do not know

Re: Spark 1.4 on HortonWork HDP 2.2

2015-06-19 Thread ayan guha
what problem are you facing? are you trying to build it yurself or gettingpre-built version? On Fri, Jun 19, 2015 at 10:22 PM, Ashish Soni asoni.le...@gmail.com wrote: Hi , Is any one able to install Spark 1.4 on HDP 2.2 , Please let me know how can i do the same ? Ashish -- Best

Spark 1.4 on HortonWork HDP 2.2

2015-06-19 Thread Ashish Soni
Hi , Is any one able to install Spark 1.4 on HDP 2.2 , Please let me know how can i do the same ? Ashish

Re: Spark 1.4 on HortonWork HDP 2.2

2015-06-19 Thread Ashish Soni
I do not where to start as Spark 1.2 comes bundled with HDP2.2 but i want to use 1.4 and i do not know how to update it to 1.4 Ashish On Fri, Jun 19, 2015 at 8:26 AM, ayan guha guha.a...@gmail.com wrote: what problem are you facing? are you trying to build it yurself or gettingpre-built

Re: Spark 1.4 on HortonWork HDP 2.2

2015-06-19 Thread Doug Balog
If you run Hadoop in secure mode and want to talk to Hive 0.14, it won’t work, see SPARK-5111 I have a patched version of 1.3.1 that I’ve been using. I haven’t had the time to get 1.4.0 working. Cheers, Doug On Jun 19, 2015, at 8:39 AM, ayan guha guha.a...@gmail.com wrote: I think you

Re: Spark 1.4 on HortonWork HDP 2.2

2015-06-19 Thread Todd Nist
You can get HDP with at least 1.3.1 from Horton: http://hortonworks.com/hadoop-tutorial/using-apache-spark-technical-preview-with-hdp-2-2/ for your convenience from the dos: wget -nv http://public-repo-1.hortonworks.com/HDP/centos6/2.x/updates/2.2.4.4/hdp.repo -O /etc/yum.repos.d/HDP-TP.repo