Hi All,
I have downloaded pre built Spark 1.1.1 for Hadoop 2.3.0 then i did mvn
install for the jar spark-assembly-1.1.1-hadoop2.3.0.jar available in lib
folder of the spark downloaded and added its dependency as following in my
java program
<dependency>
<groupId>org.apache.spark</groupId>
<artifactId>spark-core_2.10</artifactId>
<version>1.1.1</version>
<exclusions>
<exclusion>
<groupId>org.apache.hadoop</groupId>
<artifactId>hadoop-auth</artifactId>
</exclusion>
<exclusion>
<groupId>org.apache.hadoop</groupId>
<artifactId>hadoop-yarn-common</artifactId>
</exclusion>
<exclusion>
<groupId>org.apache.hadoop</groupId>
<artifactId>hadoop-mapreduce-client-core</artifactId>
</exclusion>
</exclusions>
</dependency>
I havse added my pom.xml
But when i am trying to do hBaseRDD.count(); i am gettinig following
exception
java.lang.IllegalStateException (unread block data) [duplicate 1]
pom.xml
<http://apache-spark-user-list.1001560.n3.nabble.com/file/n20746/pom.xml>
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Apache-Spark-1-1-1-with-Hbase-0-98-8-hadoop2-and-hadoop-2-3-0-tp20746.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]