As you said in your first email - the RPC engine specified by hbase.rpc.engine wasn't picked up. This means that hbase-site.xml was not on the classpath with which you launched the bulk load.
BTW it is advisable to upgrade to 0.94.20 - as you're aware there have been some fixes to secure bulk load. Cheers On Tue, Jun 10, 2014 at 7:02 PM, Bi,hongyu—mike <[email protected]> wrote: > it works! > thanks very much ! > I thought it was two commands so i run seperately: > HADOOP_CLASSPATH=`${HBASE_HOME}/bin/hbase classpath` > hadoop jar xxx completebulkload xxx xxx > > my bad. > > thanks ted! > > > 2014-06-11 9:59 GMT+08:00 Ted Yu <[email protected]>: > > > Please take a look at http://hbase.apache.org/book.html#completebulkload > > > > Notice the command which starts with: > > > > HADOOP_CLASSPATH=`${HBASE_HOME}/bin/hbase classpath` > > > > > > > > On Tue, Jun 10, 2014 at 6:41 PM, Bi,hongyu—mike <[email protected]> > wrote: > > > > > Hi , > > > I got into trouble in bulkload hfiles to hbase after i enable HBase ACL > > in > > > hbase-site.xml > > > <property> > > > <name>hbase.rpc.engine</name> > > > <value>org.apache.hadoop.hbase.ipc.SecureRpcEngine</value> > > > </property> > > > <property> > > > <name>hbase.coprocessor.master.classes</name> > > > > > <value>org.apache.hadoop.hbase.security.access.AccessController</value> > > > </property> > > > <property> > > > <name>hbase.coprocessor.region.classes</name> > > > > > > > > > > > > > <value>org.apache.hadoop.hbase.security.token.TokenProvider,org.apache.hadoop.hbase.security.access.AccessController,org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint</value> > > > </property> > > > > > > I run the command as hdfs( hadoop/hbase super user) on hmaster server > > > hadoop jar hbase-0.94.15-cdh4.6.0-security.jar completebulkload > > > hdfs://nameservicexxx:8020/hfiles_2hbase/ hbasetablename > > > > > > From the exception it seems mapreduce didn't know the hbase.rpc.engine > > > and still use the writeableRpcEngine,should i add the hbase.rpc.engine > to > > > mapred-site.xml and restart the jobtracker+tasktracker？or other > solution? > > > very appreciate for your help:) > > > > > > > > > 14/06/11 09:31:45 INFO > > client.HConnectionManager$HConnectionImplementation: > > > getMaster attempt 2 of 14 failed; retrying after sleep of 1002 > > > java.io.IOException: Call to xxx/xxx:60000 failed on local exception: > > > java.io.EOFException > > > at > > > > > > > > > org.apache.hadoop.hbase.ipc.HBaseClient.wrapException(HBaseClient.java:1047) > > > at > > > org.apache.hadoop.hbase.ipc.HBaseClient.call(HBaseClient.java:1016) > > > at > > > > > > > > > org.apache.hadoop.hbase.ipc.WritableRpcEngine$Invoker.invoke(WritableRpcEngine.java:87) > > > at $Proxy7.getProtocolVersion(Unknown Source) > > > at > > > > > > > > > org.apache.hadoop.hbase.ipc.WritableRpcEngine.getProxy(WritableRpcEngine.java:141) > > > at > > > > > > > > > org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getMaster(HConnectionManager.java:813) > > > at > > > org.apache.hadoop.hbase.client.HBaseAdmin.<init>(HBaseAdmin.java:127) > > > at > > > > > > > > > org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.<init>(LoadIncrementalHFiles.java:114) > > > at > > > > > > > > > org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.main(LoadIncrementalHFiles.java:792) > > > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > > > at > > > > > > > > > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) > > > at > > > > > > > > > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) > > > at java.lang.reflect.Method.invoke(Method.java:597) > > > at > > > > > > > > > org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:72) > > > at > > > org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:144) > > > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > > > at > > > > > > > > > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) > > > at > > > > > > > > > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) > > > at java.lang.reflect.Method.invoke(Method.java:597) > > > at > org.apache.hadoop.hbase.mapreduce.Driver.main(Driver.java:51) > > > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > > > at > > > > > > > > > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) > > > at > > > > > > > > > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) > > > at java.lang.reflect.Method.invoke(Method.java:597) > > > at org.apache.hadoop.util.RunJar.main(RunJar.java:208) > > > Caused by: java.io.EOFException > > > at java.io.DataInputStream.readInt(DataInputStream.java:375) > > > at > > > > > > > > > org.apache.hadoop.hbase.ipc.HBaseClient$Connection.receiveResponse(HBaseClient.java:654) > > > at > > > > > > > > > org.apache.hadoop.hbase.ipc.HBaseClient$Connection.run(HBaseClient.java:588) > > > > > >
