HiveAuthzContext.getForwardedAddress() was added in HIVE-13418, which has been
committed only in Hive-2.1.0. Hence you see the issue with Hive-1.2.1.
Also, support for column-masking and row-filtering was added in HIVE-13125,
which is present only in Hive-2.1.0. Since Ranger 0.6 supports policies for
column-masking and row-filtering, it would require Hive-2.1.0.
Given above, I think the documentation should be updated to show that Ranger
0.6 requires Hive-2.1.0 or higher.
If support for Hive-1.2.1 is required, I would suggest to try the following
update to Ranger Hive plugin:
- Introduce a configuration in Ranger Hive plugin (like
ranger.plugin.hive.version-1.2.1); if this is set to true the plugin should not
call HiveAuthzContext.getForwardedAddress()
Please note however that even with the above update, column-masking and
row-filter policies won’t be supported.
Hope this helps.
Madhan
From: Yan Zhou <yzhouopensou...@gmail.com>
Reply-To: "user@ranger.incubator.apache.org" <user@ranger.incubator.apache.org>
Date: Thursday, January 5, 2017 at 10:50 PM
To: "user@ranger.incubator.apache.org" <user@ranger.incubator.apache.org>,
"dev-subscr...@ranger.incubator.apache.org"
<dev-subscr...@ranger.incubator.apache.org>
Subject: Re: Ranger/Hive Version mismatch in HDP 2.5 ?
When using Ranger 0.6.0 Hive Plugin with Hive 1.2.1, a beeline SQL command
throws the following exception:
Exception in thread "HiveServer2-Handler-Pool: Thread-37"
java.lang.NoSuchMethodError:
org.apache.hadoop.hive.ql.security.authorization.plugin.HiveAuthzContext.getForwardedAddresses()Ljava/util/List;
at
org.apache.ranger.authorization.hive.authorizer.RangerHiveAccessRequest.<init>(RangerHiveAccessRequest.java:55)
at
org.apache.ranger.authorization.hive.authorizer.RangerHiveAccessRequest.<init>(RangerHiveAccessRequest.java:72)
at
org.apache.ranger.authorization.hive.authorizer.RangerHiveAuthorizer.checkPrivileges(RangerHiveAuthorizer.java:263)
at org.apache.hadoop.hive.ql.Driver.doAuthorizationV2(Driver.java:779)
at org.apache.hadoop.hive.ql.Driver.doAuthorization(Driver.java:574)
at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:468)
at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:308)
at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:1122)
at org.apache.hadoop.hive.ql.Driver.compileAndRespond(Driver.java:1116)
at
org.apache.hive.service.cli.operation.SQLOperation.prepare(SQLOperation.java:110)
at
org.apache.hive.service.cli.operation.SQLOperation.runInternal(SQLOperation.java:181)
at org.apache.hive.service.cli.operation.Operation.run(Operation.java:257)
at
org.apache.hive.service.cli.session.HiveSessionImpl.executeStatementInternal(HiveSessionImpl.java:388)
at
org.apache.hive.service.cli.session.HiveSessionImpl.executeStatementAsync(HiveSessionImpl.java:375)
at
org.apache.hive.service.cli.CLIService.executeStatementAsync(CLIService.java:274)
at
org.apache.hive.service.cli.thrift.ThriftCLIService.ExecuteStatement(ThriftCLIService.java:486)
at
org.apache.hive.service.cli.thrift.TCLIService$Processor$ExecuteStatement.getResult(TCLIService.java:1313)
at
org.apache.hive.service.cli.thrift.TCLIService$Processor$ExecuteStatement.getResult(TCLIService.java:1298)
at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
at
org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge$Server$TUGIAssumingProcessor.process(HadoopThriftAuthBridge.java:692)
at
org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:285)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
The issue seems to be that HiveAuthzContext adds a getForwardedAddresses(...)
method in Hive 2.1, which is called by Ranger 0.6 Hive Plugin
due to Ranger-962.
I'm using Ranger 0.6 and Hive built from git.
Thanks.
On Thu, Jan 5, 2017 at 1:39 PM, Madhan Neethiraj <mad...@apache.org> wrote:
Yan,
>> However Ranger 0.6.0 seems to work only with Hive 2.1.0
Can you please add details of the issues found while using Ranger 0.6 with Hive
1.2?
Thanks,
Madhan
On 1/5/17, 11:46 AM, "Don Bosco Durai" <bo...@apache.org> wrote:
Yan, you should reach out to someone within Hortonworks to answer your HDP
related question and their version numbering.
Thanks
Bosco
From: Yan Zhou <yzhouopensou...@gmail.com>
Reply-To: <user@ranger.incubator.apache.org>
Date: Thursday, January 5, 2017 at 9:43 AM
To: <user@ranger.incubator.apache.org>, <d...@ranger.incubator.apache.org>
Subject: Re: Ranger/Hive Version mismatch in HDP 2.5 ?
Can anyone help to clarify this version issue between Hive and Ranger 0.6.0
in HDP 2.5? I'm now in a dilemma where Ranger 0.6.0 forces me to use Hive 2.1
while HDP 2.5 only has Hive 1.2.1.
Many Thanks!
On Wed, Jan 4, 2017 at 1:08 PM, Yan Zhou <yzhouopensou...@gmail.com> wrote:
Ranger's pom.xml has the Hive version as 2.1.0.
Thanks
On Wed, Jan 4, 2017 at 12:15 PM, Don Bosco Durai <bo...@apache.org> wrote:
I feel we should have a matrix for the component versions supported by each
Ranger release. Having it on the main page will be good.
https://cwiki.apache.org/confluence/display/RANGER/Index
One more thing I noticed is that the Installation and User guide is still
pointing to release 0.5. If there are no changes, then we should we make a note
of it some where.
Thanks
Bosco
From: Yan Zhou <yzhouopensou...@gmail.com>
Reply-To: <user@ranger.incubator.apache.org>
Date: Wednesday, January 4, 2017 at 11:58 AM
To: <user@ranger.incubator.apache.org>
Subject: Ranger/Hive Version mismatch in HDP 2.5 ?
According to
https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.5.0/bk_release-notes/content/ch_relnotes_v250.html
, HDP 2.5 contains Ranger 0.6.0 and Hive 1.2.1. However Ranger 0.6.0 seems to
work only with Hive 2.1.0.
Please clarify what versions of Ranger and Hive will work well with each
other from HDP 2.5.
Thanks.
