I am having problems using Yammer Dropwizard (http://dropwizard.io/) with secure (Kerberos) connection to HBase: whenever I put the dropwizard jar on the classpath the HBase connection fails.
One the client: *DEBUG [2015-01-14 00:29:35,765] org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher: hconnection-0x30b9eadd-0x24ad2af4bfb21d2, quorum=cluster3-srv6:2181,cluster3-srv1:2181,cluster3-e8:2181, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SaslAuthenticated, path=null* *INFO [2015-01-14 00:29:35,926] org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation: getMaster attempt 1 of 35 failed; retrying after sleep of 100, exception=com.google.protobuf.ServiceException: java.io.IOException: Unexpected closed connection* *INFO [2015-01-14 00:29:36,031] org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation: getMaster attempt 2 of 35 failed; retrying after sleep of 200, exception=com.google.protobuf.ServiceException: java.io.IOException: Call to cluster3-srv1.e8sec.com/10.10.80.71:60000 <http://cluster3-srv1.e8sec.com/10.10.80.71:60000> failed on local exception: java.io.EOFException* On the server: *RpcServer.listener,port=60000: count of bytes read: 0* *org.apache.hadoop.hbase.security.AccessDeniedException: Authentication is required* * at org.apache.hadoop.hbase.ipc.RpcServer$Connection.readAndProcess(RpcServer.java:1460)* * at org.apache.hadoop.hbase.ipc.RpcServer$Listener.doRead(RpcServer.java:802)* * at org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.doRunLoop(RpcServer.java:593)* * at org.apache.hadoop.hbase.ipc.RpcServer$Listener$Reader.run(RpcServer.java:568)* * at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)* * at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)* * at java.lang.Thread.run(Thread.java:745)* The weird thing is that the same code works w/o the jar on the classpath. It appears something in the dropwizard code static initialization is breaking Kerberos authentication. Has anyone seen this problem before? Thanks, -- Alex Kozlov (408) 507-4987 (408) 830-9982 fax (650) 887-2135 efax [email protected]
