I saw a bunch of security related classes in the trace. I'll try with a non-secure branch and file a jira if the problem is not present there. Any input on the first issue?
-- Lars ________________________________ From: Ted Yu <[email protected]> To: [email protected]; lars hofhansl <[email protected]> Sent: Wednesday, February 22, 2012 7:43 PM Subject: Re: Some HBase M/R confusion Lars: Is the second problem present in insecure HBase ? Thanks On Wed, Feb 22, 2012 at 6:36 PM, lars hofhansl <[email protected]> wrote: According to the documentation there are two ways to run HBase M/R jobs: > > >1. The HBase book states to run M/R jobs like export here: >http://hbase.apache.org/book/ops_mgt.html#export%0Abin/hbase >org.apache.hadoop.hbase.mapreduce.Export <tablename> <outputdir> [<versions> >[<starttime> [<endtime>]]] > >2. Whereas the Javadoc says here: >http://hbase.apache.org/docs/current/api/org/apache/hadoop/hbase/mapreduce/package-summary.html#package_description >HADOOP_CLASSPATH=`${HBASE_HOME}/bin/hbase classpath` ${HADOOP_HOME}/bin/hadoop >jar ${HBASE_HOME}/hbase-0.90.0.jar export ... > > >In the first case (#1) I find that the job allways fails to create the output >dir: >java.io.IOException: Mkdirs failed to create >file:/exports/_temporary/_attempt_local_0001_m_000000_0 > at >org.apache.hadoop.fs.ChecksumFileSystem.create(ChecksumFileSystem.java:378) > >... > > >In the 2nd case (#2) I get past the creation of the output dir, and then it >fails because it cannot find class com.google.protobuf.Message. >I am using the HBase security branch and find that I need to add >com.google.protobuf.Message.class in TableMapReduceUtil.addDependencyJars. >If I do that, I can successfully run an export jobs using method #2. > > >The 2nd issue I found looks like a bug with the HBase security branch. >I am not sure about the first issue, is the documentation in the HBase book >outdated? > > >-- Lars > >
