-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/60733/
-----------------------------------------------------------
Review request for ranger, Don Bosco Durai, Colm O hEigeartaigh, Ramesh Mani,
Selvamohan Neethiraj, Velmurugan Periasamy, and Qiang Zhang.
Bugs: RANGER-1681
https://issues.apache.org/jira/browse/RANGER-1681
Repository: ranger
Description
-------
Currently, ragner-admin opens kerberos switch:
1.Configure the ranger-admin install.properties file:
hadoop_conf=/etc/hadoop/conf
2.Read the configuration items in the hadoop configuration file core-site.xml:
<property>
<name>hadoop.security.authentication</name>
<value>kerberos</value>
</property>
However, when ranger-admin opened kerberos,and the HDFS opens the HA function,
hbase-plugin service tests connection failure ,this is because ranger and
hadoop shared the same kerberos switch configuration file which caused a series
of unnecessary dependencies
2017-06-22 08:14:44,518 INFO
org.apache.ranger.services.hbase.client.HBaseClient: HBase connection has
[zookeeper.znode.parent] with value [/hbase]
2017-06-22 08:14:44,520 INFO org.apache.ranger.plugin.client.BaseClient: Init
Login: security not enabled, using username
2017-06-22 08:14:44,581 INFO
org.apache.ranger.services.hbase.client.HBaseClient: getHBaseStatus: creating
default Hbase configuration
2017-06-22 08:14:44,582 INFO
org.apache.ranger.services.hbase.client.HBaseClient: getHBaseStatus: setting
config values from client
2017-06-22 08:14:44,582 INFO
org.apache.ranger.services.hbase.client.HBaseClient: getHBaseStatus: checking
HbaseAvailability with the new config
2017-06-22 08:14:44,923 WARN org.apache.zookeeper.ClientCnxn: SASL
configuration failed: javax.security.auth.login.LoginException: No JAAS
configuration section named 'Client' was found in specified JAAS configuration
file: '/dev/null'. Will continue connection to Zookeeper server without SASL
authentication, if Zookeeper server allows it.
2017-06-22 08:14:45,033 ERROR
org.apache.ranger.services.hbase.client.HBaseClient: getHBaseStatus: Unable to
check availability of Hbase environment [hbasedev].java.io.IOException:
java.lang.reflect.InvocationTargetException
2017-06-22 08:14:45,033 ERROR
org.apache.ranger.services.hbase.client.HBaseClient: <==
HBaseClient.testConnection(): Unable to retrieve any databases using given
parameters
org.apache.ranger.plugin.client.HadoopException: getHBaseStatus: Unable to
check availability of Hbase environment [hbasedev].
at
org.apache.ranger.services.hbase.client.HBaseClient$1.run(HBaseClient.java:175)
at
org.apache.ranger.services.hbase.client.HBaseClient$1.run(HBaseClient.java:128)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:356)
at
org.apache.ranger.services.hbase.client.HBaseClient.getHBaseStatus(HBaseClient.java:128)
at
org.apache.ranger.services.hbase.client.HBaseClient.connectionTest(HBaseClient.java:100)
at
org.apache.ranger.services.hbase.client.HBaseResourceMgr.connectionTest(HBaseResourceMgr.java:47)
at
org.apache.ranger.services.hbase.RangerServiceHBase.validateConfig(RangerServiceHBase.java:59)
at
org.apache.ranger.biz.ServiceMgr$ValidateCallable.actualCall(ServiceMgr.java:560)
at
org.apache.ranger.biz.ServiceMgr$ValidateCallable.actualCall(ServiceMgr.java:547)
at
org.apache.ranger.biz.ServiceMgr$TimedCallable.call(ServiceMgr.java:508)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.IOException: java.lang.reflect.InvocationTargetException
at
org.apache.hadoop.hbase.client.ConnectionFactory.createConnection(ConnectionFactory.java:240)
at
org.apache.hadoop.hbase.client.ConnectionFactory.createConnection(ConnectionFactory.java:218)
at
org.apache.hadoop.hbase.client.ConnectionFactory.createConnection(ConnectionFactory.java:119)
at
org.apache.hadoop.hbase.client.HBaseAdmin.checkHBaseAvailable(HBaseAdmin.java:2916)
at
org.apache.ranger.services.hbase.client.HBaseClient$1.run(HBaseClient.java:138)
... 14 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
at
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
at
org.apache.hadoop.hbase.client.ConnectionFactory.createConnection(ConnectionFactory.java:238)
... 18 more
Caused by: java.lang.ExceptionInInitializerError
at org.apache.hadoop.hbase.ClusterId.parseFrom(ClusterId.java:64)
at
org.apache.hadoop.hbase.zookeeper.ZKClusterId.readClusterIdZNode(ZKClusterId.java:75)
at
org.apache.hadoop.hbase.client.ZooKeeperRegistry.getClusterId(ZooKeeperRegistry.java:105)
at
org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.retrieveClusterId(ConnectionManager.java:880)
at
org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.<init>(ConnectionManager.java:636)
... 23 more
Caused by: java.lang.IllegalArgumentException: java.net.UnknownHostException:
nameservice
at
org.apache.hadoop.security.SecurityUtil.buildTokenService(SecurityUtil.java:377)
at
org.apache.hadoop.hdfs.NameNodeProxies.createNonHAProxy(NameNodeProxies.java:320)
at
org.apache.hadoop.hdfs.NameNodeProxies.createProxy(NameNodeProxies.java:176)
at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:692)
at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:633)
at
org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:149)
at
org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2694)
at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:100)
at
org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2728)
at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2710)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:384)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:178)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:368)
at org.apache.hadoop.fs.Path.getFileSystem(Path.java:295)
at
org.apache.hadoop.hbase.util.DynamicClassLoader.initTempDir(DynamicClassLoader.java:120)
at
org.apache.hadoop.hbase.util.DynamicClassLoader.<init>(DynamicClassLoader.java:98)
at
org.apache.hadoop.hbase.protobuf.ProtobufUtil.<clinit>(ProtobufUtil.java:241)
... 28 more
Caused by: java.net.UnknownHostException: nameservice
... 45 more
2017-06-22 08:14:45,034 ERROR
org.apache.ranger.services.hbase.client.HBaseResourceMgr: <==
HBaseResourceMgr.connectionTest() Error:
org.apache.ranger.plugin.client.HadoopException: getHBaseStatus: Unable to
check availability of Hbase environment [hbasedev].
2017-06-22 08:14:45,034 ERROR
org.apache.ranger.services.hbase.RangerServiceHBase: <==
RangerServiceHBase.validateConfig()
Error:org.apache.ranger.plugin.client.HadoopException: getHBaseStatus: Unable
to check availability of Hbase environment [hbasedev].
2017-06-22 08:14:45,034 ERROR org.apache.ranger.biz.ServiceMgr:
TimedCallable.call: Error:org.apache.ranger.plugin.client.HadoopException:
getHBaseStatus: Unable to check availability of Hbase environment [hbasedev].
2017-06-22 08:14:45,035 ERROR org.apache.ranger.biz.ServiceMgr: ==>
ServiceMgr.validateConfig
Error:org.apache.ranger.plugin.client.HadoopException:
org.apache.ranger.plugin.client.HadoopException: getHBaseStatus: Unable to
check availability of Hbase environment [hbasedev].
Diffs
-----
security-admin/scripts/install.properties 268b8ac
security-admin/scripts/setup.sh 1630684
security-admin/src/main/resources/conf.dist/core-site.xml PRE-CREATION
Diff: https://reviews.apache.org/r/60733/diff/1/
Testing
-------
Thanks,
pengjianhua
