[ https://issues.apache.org/jira/browse/SPARK-22101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Sean Owen resolved SPARK-22101. ------------------------------- Resolution: Invalid This is an HBase question, not a Spark JIRA > spark over hbase snapshot > ------------------------- > > Key: SPARK-22101 > URL: https://issues.apache.org/jira/browse/SPARK-22101 > Project: Spark > Issue Type: Question > Components: Spark Core > Affects Versions: 1.6.0 > Reporter: ulysses you > > The configuration error in two method. First is ok, and second is wrong. > 1. > val hConf = HBaseConfiguration.create() > // ignore some config > val hBaseRDD = sc.newAPIHadoopRDD(hConf, > classOf[TableSnapshotInputFormat], > classOf[org.apache.hadoop.hbase.io.ImmutableBytesWritable], > classOf[org.apache.hadoop.hbase.client.Result]) > 2. > val hConf = HBaseConfiguration.create() > val job = Job.getInstance(hConf) > val hBaseRDD = sc.newAPIHadoopRDD(job.getConfiguration, > classOf[TableSnapshotInputFormat], > classOf[org.apache.hadoop.hbase.io.ImmutableBytesWritable], > classOf[org.apache.hadoop.hbase.client.Result]) > and the log: > Caused by: java.lang.ClassNotFoundException: > org.apache.hadoop.hbase.codec.prefixtree.PrefixTreeCodec > at java.net.URLClassLoader.findClass(URLClassLoader.java:381) > at java.lang.ClassLoader.loadClass(ClassLoader.java:424) > at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331) > at java.lang.ClassLoader.loadClass(ClassLoader.java:357) > at java.lang.Class.forName0(Native Method) > at java.lang.Class.forName(Class.java:264) > at > org.apache.hadoop.hbase.io.encoding.DataBlockEncoding.createEncoder(DataBlockEncoding.java:186) > ... 21 more > I'm sure that I have upload jar with spark cmd -jars. > Is this a bug? -- This message was sent by Atlassian JIRA (v6.4.14#64029) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org