Hi All,

I have downloaded pre built Spark 1.1.1 for Hadoop 2.3.0 then i did mvn
install for the jar spark-assembly-1.1.1-hadoop2.3.0.jar available in lib
folder of the spark downloaded and added its dependency as following in my
java program

<dependency>
        <groupId>org.apache.spark</groupId>
        <artifactId>spark-core_2.10</artifactId>
        <version>1.1.1</version>
               <exclusions>
       <exclusion>
          <groupId>org.apache.hadoop</groupId>
          <artifactId>hadoop-auth</artifactId>
        </exclusion>
        
        <exclusion>
          <groupId>org.apache.hadoop</groupId>
          <artifactId>hadoop-yarn-common</artifactId>
        </exclusion>
        
        
        <exclusion>
          <groupId>org.apache.hadoop</groupId>
          <artifactId>hadoop-mapreduce-client-core</artifactId>
        </exclusion>
        
       </exclusions>
        </dependency>

I havse added my pom.xml 

But when i am trying to do hBaseRDD.count(); i am gettinig following
exception 
 java.lang.IllegalStateException (unread block data) [duplicate 1]



pom.xml
<http://apache-spark-user-list.1001560.n3.nabble.com/file/n20746/pom.xml>  



--
View this message in context: 
http://apache-spark-user-list.1001560.n3.nabble.com/Apache-Spark-1-1-1-with-Hbase-0-98-8-hadoop2-and-hadoop-2-3-0-tp20746.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to