Things have changed a bit in the master branch, and the SQL programming guide in master branch actually doesn’t apply to branch-1.0-jdbc.
In branch-1.0-jdbc, Hive Thrift server and Spark SQL CLI are included in the hive profile and are thus not enabled by default. You need to either - pass -Phive to Maven to enable it, or - use SPARK_HIVE=true ./sbt/sbt assembly In the most recent master branch, however, Hive Thrift server and Spark SQL CLI are moved into a separate hive-thriftserver profile. And our SBT build file now delegates to Maven. So, to build the master branch, you can either - ./sbt/sbt -Phive-thirftserver clean assembly/assembly, or - mvn -Phive-thriftserver clean package -DskipTests On Fri, Aug 8, 2014 at 6:12 AM, ajatix <a...@sigmoidanalytics.com> wrote: Hi > > I wish to migrate from shark to the spark-sql shell, where I am facing some > difficulties in setting up. > > I cloned the "branch-1.0-jdbc" to test out the spark-sql shell, but I am > unable to run it after building the source. > > I've tried two methods for building (with Hadoop 1.0.4) - sbt/sbt assembly; > and mvn -DskipTests clean package -X. Both build successfully, but when I > run bin/spark-sql, I get the following error: > > Exception in thread "main" java.lang.ClassNotFoundException: > org.apache.spark.sql.hive.thriftserver.SparkSQLCLIDriver > at java.net.URLClassLoader$1.run(URLClassLoader.java:366) > at java.net.URLClassLoader$1.run(URLClassLoader.java:355) > at java.security.AccessController.doPrivileged(Native Method) > at java.net.URLClassLoader.findClass(URLClassLoader.java:354) > at java.lang.ClassLoader.loadClass(ClassLoader.java:425) > at java.lang.ClassLoader.loadClass(ClassLoader.java:358) > at java.lang.Class.forName0(Native Method) > at java.lang.Class.forName(Class.java:270) > at > org.apache.spark.deploy.SparkSubmit$.launch(SparkSubmit.scala:311) > at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:73) > at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala) > > and when I run bin/beeline, I get this: > Error: Could not find or load main class org.apache.hive.beeline.BeeLine > > bin/spark-shell works fine. It there something else I have to add to the > build parameters? > According to this - > https://github.com/apache/spark/blob/master/docs/sql-programming-guide.md, > I > tried rebuilding with -Phive-thriftserver, but it failed to detect the > library while building. > > Thanks and Regards > Ajay > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/Missing-SparkSQLCLIDriver-and-Beeline-drivers-in-Spark-tp11724.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. > > --------------------------------------------------------------------- > To unsubscribe, e-mail: user-unsubscr...@spark.apache.org > For additional commands, e-mail: user-h...@spark.apache.org > >
