Re:Re: Re: Re: Error in load hbase on spark

2015-10-09 Thread roywang1024
Finally I fix it . It just cause by "ClassNotFoundException: org.apache.htrace.Trace". I can't see this message in logs on driver node,but can be found on worker node. And I modify "spark.executor.extraClassPath" in spark-default.conf still not work.Also modify classpath.txt on every node. It

Re: Re: Re: Error in load hbase on spark

2015-10-09 Thread Ted Yu
Can you pastebin log snippet showing hbase related errors ? Please also consider posting the question on vendor's forum. On Thu, Oct 8, 2015 at 10:17 PM, roywang1024 wrote: > > I add hbase-conf-dir to spark/conf/classpath.txt,but still error. > > > > > > At 2015-10-09

Re: Error in load hbase on spark

2015-10-09 Thread Guru Medasani
Hi Roy, Here is a cloudera-labs project SparkOnHBase that makes it really simple to read HBase data into Spark. https://github.com/cloudera-labs/SparkOnHBase Link to blog that explains how to use the package.

Re: Error in load hbase on spark

2015-10-09 Thread Ted Yu
Work for hbase-spark module is still ongoing https://issues.apache.org/jira/browse/HBASE-14406 > On Oct 9, 2015, at 6:18 AM, Guru Medasani wrote: > > Hi Roy, > > Here is a cloudera-labs project SparkOnHBase that makes it really simple to > read HBase data into Spark. > >

Re: Re: Error in load hbase on spark

2015-10-08 Thread Ted Yu
The second code snippet is similar to: examples//src/main/scala/org/apache/spark/examples/HBaseTest.scala See the comment in HBaseTest.scala : // please ensure HBASE_CONF_DIR is on classpath of spark driver // e.g: set it through spark.driver.extraClassPath property // in

Re: Error in load hbase on spark

2015-10-08 Thread Ted Yu
One possibility was that hbase config, including hbase.zookeeper.quorum, was not passed to your job. hbase-site.xml should be on the classpath. Can you show snippet of your code ? Looks like you were running against hbase 1.x Cheers On Thu, Oct 8, 2015 at 7:29 PM, Roy Wang