Andrew, Thank you very much. That is exactly what I did, I downloaded 0.8.0
of spark, rebuilt it and now I am able to connect to spark successfully. I
am however running into another issue when trying to run commands from the
shark shell,
a simple show tables; command gives me this error. I have configured
hive-default.xml and placed it in the hive directory packaged with shark.
> show tables;
java.lang.NoSuchFieldError: METASTORE_MODE
at
org.apache.hadoop.hive.metastore.HiveMetaStoreClient.<init>(HiveMetaStoreClient.java:110)
at
org.apache.hadoop.hive.ql.metadata.Hive.createMetaStoreClient(Hive.java:2092)
at org.apache.hadoop.hive.ql.metadata.Hive.getMSC(Hive.java:2102)
at org.apache.hadoop.hive.ql.metadata.Hive.getDatabase(Hive.java:1076)
at
org.apache.hadoop.hive.ql.metadata.Hive.databaseExists(Hive.java:1065)
at org.apache.hadoop.hive.ql.exec.DDLTask.showTables(DDLTask.java:1992)
at org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:323)
at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:134)
at
org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:57)
at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1312)
at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1104)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:937)
at shark.SharkCliDriver.processCmd(SharkCliDriver.scala:294)
at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:406)
at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:341)
at shark.SharkCliDriver$.main(SharkCliDriver.scala:203)
at shark.SharkCliDriver.main(SharkCliDriver.scala)
FAILED: Execution Error, return code -101 from
org.apache.hadoop.hive.ql.exec.DDLTask
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/PLEASE-HELP-shark-withinfo-not-connecting-to-spark-master-tp419p426.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.