I have created JIRA, you can find here <https://issues.apache.org/jira/browse/RANGER-769>
On Mon, Dec 7, 2015 at 3:35 AM, Aneela Saleem <[email protected]> wrote: > Sure Bosco! > > On Mon, Dec 7, 2015 at 3:05 AM, Don Bosco Durai <[email protected]> wrote: > >> Yes, thanks for verifying it. We should have http-core in the plugin >> folder. >> >> Would you be able to do the change and upload the patch for review? One >> of the commuters can commit the code behalf of you. >> >> We might have to update src/main/assembly/hbase-agent.xml. Can you also >> create a JIRA for this? >> >> Thanks >> >> Bosco >> >> >> From: Aneela Saleem <[email protected]> >> Reply-To: <[email protected]> >> Date: Sunday, December 6, 2015 at 12:13 PM >> To: <[email protected]> >> >> Subject: Re: Hbase policy issue >> >> Bosco! >> >> I have Reverted changes, place httpcore-4.1.3.jar in hbase/lib again. >> Place httpcore-4.2.5.jar in ranger-hbase-plugin-impl folder. And now it's >> also working. >> Bosco! there is no http-core by default in hbase-plugin and http-client >> in hdfs plugin. I think it should be there by default. >> >> Thanks >> >> On Sun, Dec 6, 2015 at 11:59 PM, Don Bosco Durai <[email protected]> >> wrote: >> >>> Aneela, thanks >>> >>> Madhan, we should have both the jars in our plugin impl folder and make >>> sure it works. >>> >>> Aneela, if you don't mind, can you do one experiment? Can you revert >>> your change? Have the old httpcore in the hbase lib folder, but add the >>> 4.2.5 in the ranger-impl folder (check under lib folder) and try it out? >>> >>> If it works, then we don't have to manually update the hbase libraries. >>> >>> Thanks >>> >>> Bosco >>> >>> >>> _____________________________ >>> From: Aneela Saleem <[email protected]> >>> Sent: Sunday, December 6, 2015 5:09 AM >>> Subject: Re: Hbase policy issue >>> To: <[email protected]> >>> >>> >>> >>> The issue was due to incompatible http-core version. Hbase by default >>> has old version oh http-core. Replace old one with >>> httpcore-4.4.2.jar that is compatible with httpclient-4.2.5.jar. >>> >>> On Sat, Dec 5, 2015 at 10:43 PM, Aneela Saleem <[email protected]> >>> wrote: >>> >>>> Hi Madhan! >>>> >>>> In my Hadoop directory, The command *find . -name >>>> "ranger-plugins-common*.jar" | xargs ls –l * produces following output >>>> ./share/hadoop/hdfs/lib/ranger-hdfs-plugin-impl/ranger-plugins-common-0.5.0.jar >>>> >>>> >>>> >>>> And above authorization issue is resolved now. >>>> >>>> Thanks >>>> >>>> >>>> >>>> On Sat, Dec 5, 2015 at 10:33 PM, Madhan Neethiraj <[email protected]> >>>> wrote: >>>> >>>>> Aneela, >>>>> >>>>> Was the earlier issue with HBase authorization resolved now? This >>>>> exception should not impact the authorization. >>>>> >>>>> Thanks, >>>>> Madhan >>>>> >>>>> From: Aneela Saleem <[email protected]> >>>>> Reply-To: "[email protected]" < >>>>> [email protected]> >>>>> Date: Saturday, December 5, 2015 at 9:28 AM >>>>> To: " [email protected]" < >>>>> [email protected]> >>>>> Subject: Re: Hbase policy issue >>>>> >>>>> Hi Madhan! >>>>> >>>>> I reinstallled hbase plugin and checked the logs. Now the exception >>>>> changed to following >>>>> >>>>> 2015-12-05 22:25:42,251 FATAL >>>>> [org.apache.ranger.audit.queue.AuditBatchQueue0] >>>>> destination.SolrAuditDestination: Can't connect to Solr server. URL=[ >>>>> http://192.168.23.126:6083/solr/ranger_audits] >>>>> java.lang.NoSuchFieldError: DEF_CONTENT_CHARSET >>>>> at >>>>> org.apache.http.impl.client.DefaultHttpClient.setDefaultHttpParams(DefaultHttpClient.java:175) >>>>> >>>>> at >>>>> org.apache.http.impl.client.DefaultHttpClient.createHttpParams(DefaultHttpClient.java:158) >>>>> >>>>> at >>>>> org.apache.http.impl.client.AbstractHttpClient.getParams(AbstractHttpClient.java:448) >>>>> >>>>> at >>>>> org.apache.solr.client.solrj.impl.HttpClientUtil.setConnectionTimeout(HttpClientUtil.java:267) >>>>> >>>>> at >>>>> org.apache.solr.client.solrj.impl.LBHttpSolrClient.setConnectionTimeout(LBHttpSolrClient.java:460) >>>>> >>>>> at >>>>> org.apache.ranger.audit.destination.SolrAuditDestination.connect(SolrAuditDestination.java:116) >>>>> >>>>> at >>>>> org.apache.ranger.audit.destination.SolrAuditDestination.log(SolrAuditDestination.java:138) >>>>> >>>>> at >>>>> org.apache.ranger.audit.queue.AuditBatchQueue.runDoAs(AuditBatchQueue.java:320) >>>>> >>>>> at >>>>> org.apache.ranger.audit.queue.AuditBatchQueue$1.run(AuditBatchQueue.java:217) >>>>> >>>>> at >>>>> org.apache.ranger.audit.queue.AuditBatchQueue$1.run(AuditBatchQueue.java:215) >>>>> >>>>> at java.security.AccessController.doPrivileged(Native Method) >>>>> at javax.security.auth.Subject.doAs(Subject.java:356) >>>>> at >>>>> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1594) >>>>> >>>>> at >>>>> org.apache.ranger.audit.queue.AuditBatchQueue.run(AuditBatchQueue.java:223) >>>>> at java.lang.Thread.run(Thread.java:745) >>>>> >>>>> >>>>> >>>>> >>>>> On Sat, Dec 5, 2015 at 9:58 PM, Hafiz Mujadid < >>>>> [email protected]> wrote: >>>>> >>>>>> hi Madhan! >>>>>> >>>>>> I have compiled ranger master branch code. Both the hbase and >>>>>> hbase-admin have same versions. I have hbase version 1.1.2. >>>>>> >>>>>> Thanks >>>>>> >>>>>> On Sat, Dec 5, 2015 at 9:20 PM, Madhan Neethiraj <[email protected]> >>>>>> wrote: >>>>>> >>>>>>> Aneela, >>>>>>> >>>>>>> It looks like the Ranger HBase plugin used in this environment is >>>>>>> from an earlier version than the Ranger Admin. Can you please send the >>>>>>> version details to troubleshoot this further? >>>>>>> >>>>>>> While we look at fixing the issue in the code, you should be able to >>>>>>> continue by using Ranger HBase plugin from the same version as Ranger >>>>>>> Admin. >>>>>>> >>>>>>> Thanks, >>>>>>> Madhan >>>>>>> >>>>>>> From: Aneela Saleem < [email protected]> >>>>>>> Reply-To: " [email protected]" < >>>>>>> [email protected]> >>>>>>> Date: Saturday, December 5, 2015 at 7:43 AM >>>>>>> To: " [email protected]" < >>>>>>> [email protected]> >>>>>>> Subject: Hbase policy issue >>>>>>> >>>>>>> Hi! >>>>>>> >>>>>>> I have made a policy on hbase table *emp *with column family *f1 * >>>>>>> and column *name.* >>>>>>> I gave mike user the permission of read and roger have all >>>>>>> permissions. >>>>>>> >>>>>>> But when i scan table using user mike or roger even. It does not >>>>>>> allow >>>>>>> *ERROR: org.apache.hadoop.hbase.security.AccessDeniedException: >>>>>>> Insufficient permissions for user ‘roger',action: scannerOpen, >>>>>>> tableName:emp, family:f1* >>>>>>> >>>>>>> No audits are being shown and hbase logs have following exception >>>>>>> >>>>>>> 2015-12-05 20:42:32,976 ERROR [Thread-75] util.PolicyRefresher: >>>>>>> PolicyRefresher(serviceName=hbasedev): failed to refresh policies. Will >>>>>>> continue to use last known version of policies (-1) >>>>>>> com.sun.jersey.api.client.ClientHandlerException: >>>>>>> org.codehaus.jackson.map.exc.UnrecognizedPropertyException: Unrecognized >>>>>>> field "isEnabled" (Class >>>>>>> org.apache.ranger.plugin.model.RangerPolicy$RangerPolicyItem), not >>>>>>> marked >>>>>>> as ignorable >>>>>>> at [Source: >>>>>>> sun.net.www.protocol.http.HttpURLConnection$HttpInputStream@28826668; >>>>>>> line: 1, column: 938] (through reference chain: >>>>>>> org.apache.ranger.plugin.util.ServicePolicies["policies"]->org.apache.ranger.plugin.model.RangerPolicy["policyItems"]->org.apache.ranger.plugin.model.RangerPolicyItem["isEnabled"]) >>>>>>> >>>>>>> at >>>>>>> com.sun.jersey.api.client.ClientResponse.getEntity(ClientResponse.java:563) >>>>>>> at >>>>>>> com.sun.jersey.api.client.ClientResponse.getEntity(ClientResponse.java:506) >>>>>>> at >>>>>>> org.apache.ranger.admin.client.RangerAdminRESTClient.getServicePoliciesIfUpdated(RangerAdminRESTClient.java:76) >>>>>>> >>>>>>> at >>>>>>> org.apache.ranger.plugin.util.PolicyRefresher.loadPolicyfromPolicyAdmin(PolicyRefresher.java:205) >>>>>>> >>>>>>> at >>>>>>> org.apache.ranger.plugin.util.PolicyRefresher.loadPolicy(PolicyRefresher.java:175) >>>>>>> >>>>>>> at >>>>>>> org.apache.ranger.plugin.util.PolicyRefresher.run(PolicyRefresher.java:154) >>>>>>> Caused by: >>>>>>> org.codehaus.jackson.map.exc.UnrecognizedPropertyException: Unrecognized >>>>>>> field "isEnabled" (Class >>>>>>> org.apache.ranger.plugin.model.RangerPolicy$RangerPolicyItem), not >>>>>>> marked >>>>>>> as ignorable >>>>>>> at [Source: >>>>>>> sun.net.www.protocol.http.HttpURLConnection$HttpInputStream@28826668; >>>>>>> line: 1, column: 938] (through reference chain: >>>>>>> org.apache.ranger.plugin.util.ServicePolicies["policies"]->org.apache.ranger.plugin.model.RangerPolicy["policyItems"]->org.apache.ranger.plugin.model.RangerPolicyItem["isEnabled"]) >>>>>>> >>>>>>> at >>>>>>> org.codehaus.jackson.map.exc.UnrecognizedPropertyException.from(UnrecognizedPropertyException.java:53) >>>>>>> >>>>>>> at >>>>>>> org.codehaus.jackson.map.deser.StdDeserializationContext.unknownFieldException(StdDeserializationContext.java:267) >>>>>>> >>>>>>> at >>>>>>> org.codehaus.jackson.map.deser.std.StdDeserializer.reportUnknownProperty(StdDeserializer.java:673) >>>>>>> >>>>>>> at >>>>>>> org.codehaus.jackson.map.deser.std.StdDeserializer.handleUnknownProperty(StdDeserializer.java:659) >>>>>>> >>>>>>> at >>>>>>> org.codehaus.jackson.map.deser.BeanDeserializer.handleUnknownProperty(BeanDeserializer.java:1365) >>>>>>> >>>>>>> at >>>>>>> org.codehaus.jackson.map.deser.BeanDeserializer._handleUnknown(BeanDeserializer.java:725) >>>>>>> >>>>>>> at >>>>>>> org.codehaus.jackson.map.deser.BeanDeserializer.deserializeFromObject(BeanDeserializer.java:703) >>>>>>> >>>>>>> at >>>>>>> org.codehaus.jackson.map.deser.BeanDeserializer.deserialize(BeanDeserializer.java:580) >>>>>>> >>>>>>> at >>>>>>> org.codehaus.jackson.map.deser.std.CollectionDeserializer.deserialize(CollectionDeserializer.java:217) >>>>>>> >>>>>>> at >>>>>>> org.codehaus.jackson.map.deser.std.CollectionDeserializer.deserialize(CollectionDeserializer.java:194) >>>>>>> >>>>>>> at >>>>>>> org.codehaus.jackson.map.deser.std.CollectionDeserializer.deserialize(CollectionDeserializer.java:30) >>>>>>> >>>>>>> at >>>>>>> org.codehaus.jackson.map.deser.SettableBeanProperty.deserialize(SettableBeanProperty.java:299) >>>>>>> >>>>>>> at >>>>>>> org.codehaus.jackson.map.deser.SettableBeanProperty$FieldProperty.deserializeAndSet(SettableBeanProperty.java:579) >>>>>>> >>>>>>> at >>>>>>> org.codehaus.jackson.map.deser.BeanDeserializer.deserializeFromObject(BeanDeserializer.java:697) >>>>>>> >>>>>>> at >>>>>>> org.codehaus.jackson.map.deser.BeanDeserializer.deserialize(BeanDeserializer.java:580) >>>>>>> >>>>>>> at >>>>>>> org.codehaus.jackson.map.deser.std.CollectionDeserializer.deserialize(CollectionDeserializer.java:217) >>>>>>> >>>>>>> at >>>>>>> org.codehaus.jackson.map.deser.std.CollectionDeserializer.deserialize(CollectionDeserializer.java:194) >>>>>>> >>>>>>> at >>>>>>> org.codehaus.jackson.map.deser.std.CollectionDeserializer.deserialize(CollectionDeserializer.java:30) >>>>>>> >>>>>>> at >>>>>>> org.codehaus.jackson.map.deser.SettableBeanProperty.deserialize(SettableBeanProperty.java:299) >>>>>>> >>>>>>> at >>>>>>> org.codehaus.jackson.map.deser.SettableBeanProperty$FieldProperty.deserializeAndSet(SettableBeanProperty.java:579) >>>>>>> >>>>>>> at >>>>>>> org.codehaus.jackson.map.deser.BeanDeserializer.deserializeFromObject(BeanDeserializer.java:697) >>>>>>> >>>>>>> at >>>>>>> org.codehaus.jackson.map.deser.BeanDeserializer.deserialize(BeanDeserializer.java:580) >>>>>>> >>>>>>> at >>>>>>> org.codehaus.jackson.map.ObjectMapper._readValue(ObjectMapper.java:2704) >>>>>>> at >>>>>>> org.codehaus.jackson.map.ObjectMapper.readValue(ObjectMapper.java:1315) >>>>>>> at >>>>>>> org.codehaus.jackson.jaxrs.JacksonJsonProvider.readFrom(JacksonJsonProvider.java:419) >>>>>>> >>>>>>> at >>>>>>> com.sun.jersey.api.client.ClientResponse.getEntity(ClientResponse.java:553) >>>>>>> ... 5 more >>>>>>> 2015-12-05 20:42:32,977 WARN [Thread-75] util.PolicyRefresher: >>>>>>> cache file does not exist or not readble >>>>>>> '/etc/ranger/hbasedev/policycache/hbaseRegional_hbasedev.json' >>>>>>> >>>>>>> >>>>>>> >>>>>>> Thanks >>>>>>> >>>>>> >>>>>> >>>>>> >>>>>> -- >>>>>> Regards: HAFIZ MUJADID >>>>>> >>>>> >>>>> >>>> >>> >>> >>> >> >
