Re: Error with Hive 2.1.1 and Spark 2.1

2017-04-19 Thread Krishnanand Khambadkone
It is complaining about a missing class file SparkJavaListener which was removed starting version 2.x of Spark.  Supposedly will be re-instated in 2.2.0.   On Monday, April 17, 2017 6:22 PM, hernan saab wrote: hernan saab (hernan_javier_s...@yahoo.com)

Re: Error with Hive 2.1.1 and Spark 2.1

2017-04-18 Thread hernan saab
Edward,Consider putting together a project at the time of documentation. This way, users at least know all the variables that you use to prove a particular configuration works.Use GIT, its a simple revision control tool that developers at the Hive community should get confortable with. It

Re: Error with Hive 2.1.1 and Spark 2.1

2017-04-18 Thread Edward Capriolo
On Tue, Apr 18, 2017 at 3:32 PM, hernan saab wrote: > The effort of configuring an apache big data system by hand for your > particular needs is equivalent to herding rattlesnakes and cats into one > small room. > The documentation is poor and most of the time the

Re: Error with Hive 2.1.1 and Spark 2.1

2017-04-18 Thread hernan saab
The effort of configuring an apache big data system by hand for your particular needs is equivalent to herding rattlesnakes and cats into one small room.The documentation is poor and most of the time the community developers don't really feel like helping you.Use Ambari or any other

Re: Error with Hive 2.1.1 and Spark 2.1

2017-04-18 Thread Vihang Karajgaonkar
+sergio Thank you for pointing this out. Based on what I see here https://github.com/apache/hive/blob/branch-2.1/pom.xml#L179 Hive 2.1 supports Sparks 1.6. There is a JIRA to add support for Spark 2.0 https://issues.apache.org/jira/browse/HIVE-14029 but that is available from Hive 2.2.x I have

Re: Error with Hive 2.1.1 and Spark 2.1

2017-04-17 Thread hernan saab
IMO, that page is a booby trap for the newbies to make them waste their time needlessly.As far as I know Hive on Spark does not work today.I would be the reason that page still stays on is because there is a level of shame in the Hive dev community that a feature like this should be functional

Error with Hive 2.1.1 and Spark 2.1

2017-04-17 Thread Krishnanand Khambadkone
Hi,   I am trying to run Hive queries by using Spark as the execution engine.   I am following the instructions on this page, https://cwiki.apache.org/confluence/display/Hive/Hive+on+Spark%3A+Getting+Started When I try to run my query which is. a simple count(*) command, I get this error,