Re: Review Request 72205: RANGER-2752: Add corresponding upgrade patch for RANGER-2550

2020-06-14 Thread Andrew Luo

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/72205/#review221003
---



Seems to be replaced by https://reviews.apache.org/r/72383/

- Andrew Luo


On March 6, 2020, 4:28 a.m., Andrew Luo wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/72205/
> ---
> 
> (Updated March 6, 2020, 4:28 a.m.)
> 
> 
> Review request for ranger and Pradeep Agrawal.
> 
> 
> Bugs: RANGER-2752
> https://issues.apache.org/jira/browse/RANGER-2752
> 
> 
> Repository: ranger
> 
> 
> Description
> ---
> 
> Upgrading from 0.7.0 to the current master fails with the following error:
>  
> 2020-03-04 07:38:00,523  [JISQL] /usr/lib/jvm/java-8-openjdk-amd64/bin/java  
> -cp 
> /opt/mysql-connector-java-5.1.48.jar:/opt/ranger-2.1.0-SNAPSHOT-admin/jisql/lib/*
>  org.apache.util.sql.Jisql -driver mysqlconj -cstring 
> jdbc:mysql://ranger-mysql/ranger -u 'ranger' -p '' -noheader -trim -c 
> \;  -query "insert into x_db_version_h (version, inst_at, inst_by, 
> updated_at, updated_by,active) values ('J10015', current_timestamp, 'Ranger 
> 2.1.0-SNAPSHOT', current_timestamp, '306a9688fa98','N') ;"
> Wed Mar 04 07:38:01 UTC 2020 WARN: Establishing SSL connection without 
> server's identity verification is not recommended. According to MySQL 
> 5.5.45+, 5.6.26+ and 5.7.6+ requirements SSL connection must be established 
> by default if explicit option isn't set. For compliance with existing 
> applications not using SSL the verifyServerCertificate property is set to 
> 'false'. You need either to explicitly disable SSL by setting useSSL=false, 
> or set useSSL=true and provide truststore for server certificate verification.
> 2020-03-04 07:38:01,164  [I] java patch PatchForKafkaServiceDefUpdate_J10015 
> is being applied..
> Wed Mar 04 07:38:11 UTC 2020 WARN: Establishing SSL connection without 
> server's identity verification is not recommended. According to MySQL 
> 5.5.45+, 5.6.26+ and 5.7.6+ requirements SSL connection must be established 
> by default if explicit option isn't set. For compliance with existing 
> applications not using SSL the verifyServerCertificate property is set to 
> 'false'. You need either to explicitly disable SSL by setting useSSL=false, 
> or set useSSL=true and provide truststore for server certificate verification.
> Wed Mar 04 07:38:11 UTC 2020 WARN: Establishing SSL connection without 
> server's identity verification is not recommended. According to MySQL 
> 5.5.45+, 5.6.26+ and 5.7.6+ requirements SSL connection must be established 
> by default if explicit option isn't set. For compliance with existing 
> applications not using SSL the verifyServerCertificate property is set to 
> 'false'. You need either to explicitly disable SSL by setting useSSL=false, 
> or set useSSL=true and provide truststore for server certificate verification.
> Wed Mar 04 07:38:11 UTC 2020 WARN: Establishing SSL connection without 
> server's identity verification is not recommended. According to MySQL 
> 5.5.45+, 5.6.26+ and 5.7.6+ requirements SSL connection must be established 
> by default if explicit option isn't set. For compliance with existing 
> applications not using SSL the verifyServerCertificate property is set to 
> 'false'. You need either to explicitly disable SSL by setting useSSL=false, 
> or set useSSL=true and provide truststore for server certificate verification.
> Wed Mar 04 07:38:11 UTC 2020 WARN: Establishing SSL connection without 
> server's identity verification is not recommended. According to MySQL 
> 5.5.45+, 5.6.26+ and 5.7.6+ requirements SSL connection must be established 
> by default if explicit option isn't set. For compliance with existing 
> applications not using SSL the verifyServerCertificate property is set to 
> 'false'. You need either to explicitly disable SSL by setting useSSL=false, 
> or set useSSL=true and provide truststore for server certificate verification.
> Wed Mar 04 07:38:11 UTC 2020 WARN: Establishing SSL connection without 
> server's identity verification is not recommended. According to MySQL 
> 5.5.45+, 5.6.26+ and 5.7.6+ requirements SSL connection must be established 
> by default if explicit option isn't set. For compliance with existing 
> applications not using SSL the verifyServerCertificate property is set to 
> 'false'. You need either to explicitly disable SSL by setting useSSL=false, 
> or set useSSL=true and provide truststore for server certificate verification.
> [EL Warning]: 2020-03-04 07:38:19.282-ClientSession(841450293)-Exception 
> [EclipseLink-4002] (Eclipse Persistence Services - 2.5.2.v20140319-9ad6abd): 
> org.eclipse.persistence.exceptions.DatabaseException
> Internal Exception: 

[jira] [Commented] (RANGER-2859) Trying to install apache ranger2.0 from apache project but not able to obtain the plugin for nifi and nifi-registry post build.

2020-06-14 Thread Santosh (Jira)


[ 
https://issues.apache.org/jira/browse/RANGER-2859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17135225#comment-17135225
 ] 

Santosh commented on RANGER-2859:
-

Mdhan,

 

I am need the 2.0. Not sure if my git clone might have pointed to master. But I 
did run against the 2.0 and same issue.

 

Can you please provide instructions to build below plugins. That should get me 
the plugin I am looking for

 

Ranger plugins for NiFi and NiFi-Registry are not part of Ranger repository. 
The implementations are available in their own repositories, as given below:
 - NiFi plugin: 
[https://github.com/apache/nifi/tree/master/nifi-nar-bundles/nifi-ranger-bundle/nifi-ranger-plugin]
 - NiFi Registry plugin: at 
[https://github.com/apache/nifi-registry/tree/master/nifi-registry-extensions/nifi-registry-ranger/nifi-registry-ranger-plugin]

> Trying to install apache ranger2.0 from apache project but not able to obtain 
> the plugin for nifi and nifi-registry post build.
> ---
>
> Key: RANGER-2859
> URL: https://issues.apache.org/jira/browse/RANGER-2859
> Project: Ranger
>  Issue Type: Bug
>  Components: plugins
>Affects Versions: 2.0.0
> Environment: Dev
>Reporter: Santosh
>Priority: Blocker
> Attachments: mavenbuildLog.out
>
>
> Tried downloading the source tar from below location for apache ranger 2.0 
> and ran maven to build the install binaries.
>  
> [*http://apache.mirrors.pair.com/ranger/2.0.0/apache-ranger-2.0.0.tar.gz*]
>  
> I am unable to obtain the plugins post build for nifi and nifi registry for 
> some reason. I also tried git build directly pointing to source ranger 2.0 
> snapshot but no luck.  Please take a look and see if anyone has any insights 
> on this. Please reach out to me if you have any questions.
>  
> After maven build is completed this is what it looks like in the target 
> folder.
>  
> apache-ranger-2.0.0/target
> [root@nifi04 target]# ls -lrt
> total 1310660
> drwxr-xr-x 3 root root        21 Jun 12 18:29 maven-shared-archive-resources
> drwxr-xr-x 2 root root        27 Jun 12 18:29 antrun
> -rw-r--r-- 1 root root         5 Jun 12 18:41 version
> drwxr-xr-x 2 root root         6 Jun 12 18:44 archive-tmp
> -rw-r--r-- 1 root root  23971518 Jun 12 18:44 ranger-2.0.0-hdfs-plugin.tar.gz
> -rw-r--r-- 1 root root  23997609 Jun 12 18:44 ranger-2.0.0-hdfs-plugin.zip
> -rw-r--r-- 1 root root  23826208 Jun 12 18:45 ranger-2.0.0-hive-plugin.tar.gz
> -rw-r--r-- 1 root root  23854842 Jun 12 18:45 ranger-2.0.0-hive-plugin.zip
> -rw-r--r-- 1 root root  26647396 Jun 12 18:45 ranger-2.0.0-hbase-plugin.tar.gz
> -rw-r--r-- 1 root root  2101 Jun 12 18:45 ranger-2.0.0-hbase-plugin.zip
> -rw-r--r-- 1 root root  28391056 Jun 12 18:46 ranger-2.0.0-knox-plugin.tar.gz
> -rw-r--r-- 1 root root  28411089 Jun 12 18:46 ranger-2.0.0-knox-plugin.zip
> -rw-r--r-- 1 root root  37234835 Jun 12 18:46 ranger-2.0.0-storm-plugin.tar.gz
> -rw-r--r-- 1 root root  37268867 Jun 12 18:47 ranger-2.0.0-storm-plugin.zip
> -rw-r--r-- 1 root root  39935738 Jun 12 18:47 ranger-2.0.0-kafka-plugin.tar.gz
> -rw-r--r-- 1 root root  39984008 Jun 12 18:47 ranger-2.0.0-kafka-plugin.zip
> -rw-r--r-- 1 root root  23958607 Jun 12 18:47 ranger-2.0.0-yarn-plugin.tar.gz
> -rw-r--r-- 1 root root  23992472 Jun 12 18:48 ranger-2.0.0-yarn-plugin.zip
> -rw-r--r-- 1 root root  26388332 Jun 12 18:48 ranger-2.0.0-ozone-plugin.tar.gz
> -rw-r--r-- 1 root root  26421265 Jun 12 18:48 ranger-2.0.0-ozone-plugin.zip
> -rw-r--r-- 1 root root  26977612 Jun 12 18:49 ranger-2.0.0-solr-plugin.tar.gz
> -rw-r--r-- 1 root root  27010184 Jun 12 18:49 ranger-2.0.0-solr-plugin.zip
> -rw-r--r-- 1 root root 248574063 Jun 12 18:54 ranger-2.0.0-admin.tar.gz
> -rw-r--r-- 1 root root 249669120 Jun 12 19:00 ranger-2.0.0-admin.zip
> -rw-r--r-- 1 root root     42210 Jun 12 19:00 
> ranger-2.0.0-solr_audit_conf.tar.gz
> -rw-r--r-- 1 root root     45636 Jun 12 19:00 ranger-2.0.0-solr_audit_conf.zip
> -rw-r--r-- 1 root root  16256274 Jun 12 19:00 ranger-2.0.0-usersync.tar.gz
> -rw-r--r-- 1 root root  16280481 Jun 12 19:00 ranger-2.0.0-usersync.zip
> -rw-r--r-- 1 root root  32771327 Jun 12 19:01 ranger-2.0.0-tagsync.tar.gz
> -rw-r--r-- 1 root root  32781600 Jun 12 19:01 ranger-2.0.0-tagsync.zip
> -rw-r--r-- 1 root root     34221 Jun 12 19:01 
> ranger-2.0.0-migration-util.tar.gz
> -rw-r--r-- 1 root root     37740 Jun 12 19:01 ranger-2.0.0-migration-util.zip
> -rw-r--r-- 1 root root  90990177 Jun 12 19:02 ranger-2.0.0-kms.tar.gz
> -rw-r--r-- 1 root root  91106503 Jun 12 19:04 ranger-2.0.0-kms.zip
> -rw-r--r-- 1 root root  22231350 Jun 12 19:04 ranger-2.0.0-ranger-tools.tar.gz
> -rw-r--r-- 1 root root  22248295 Jun 12 19:05 ranger-2.0.0-ranger-tools.zip
> -rw-r--r-- 1 root root   4039688 Jun 

[jira] [Commented] (RANGER-2860) Documentaion to build and install ranger

2020-06-14 Thread Santosh (Jira)


[ 
https://issues.apache.org/jira/browse/RANGER-2860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17135216#comment-17135216
 ] 

Santosh commented on RANGER-2860:
-

Thanks Ramesh !

Where can I find the build binaries and steps to build the 
nifi-plugin-version.tgz and nifi-registry plugin build?

 

> Documentaion to build and install ranger
> 
>
> Key: RANGER-2860
> URL: https://issues.apache.org/jira/browse/RANGER-2860
> Project: Ranger
>  Issue Type: Improvement
>  Components: documentation
>Affects Versions: 2.0.0
>Reporter: Santosh
>Priority: Major
>
> I am trying to build and install apache ranger 2.0. Looking at the install 
> guide, it is very old and most of the steps including the plugins for nifi 
> and nifi registry install missing. Can you please point me if this is the 
> right location to find it?
> [https://cwiki.apache.org/confluence/display/RANGER/Ranger+Installation+Guide]
>  
> Thanks in advance !!
>  
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (RANGER-2856) A policy should be deleted if it has no policyItems

2020-06-14 Thread RickyMa (Jira)


[ 
https://issues.apache.org/jira/browse/RANGER-2856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17135188#comment-17135188
 ] 

RickyMa commented on RANGER-2856:
-

[~madhan] : I got your point now. I didn't know that. That explains it.

I added an API. The patch is ready. Please have a look. Thanks a lot.

pull request: [https://github.com/apache/ranger/pull/66/files]

> A policy should be deleted if it has no policyItems
> ---
>
> Key: RANGER-2856
> URL: https://issues.apache.org/jira/browse/RANGER-2856
> Project: Ranger
>  Issue Type: Bug
>  Components: admin, Ranger
>Affects Versions: master
>Reporter: RickyMa
>Priority: Minor
> Fix For: master
>
> Attachments: RANGER-2856.patch
>
>  Time Spent: 10m
>  Remaining Estimate: 0h
>
> Condition: A policy contains only one policyItem and the policyItem only sets 
> one user and no groups.
> Action: Delete the user in the policyItem using API: 
> '[http://ip:6080/service/xusers/users/\{id}?forceDelete=true'|http://ip:6080/service/xusers/users/id?forceDelete=true%27,]
> Result: The policy still exists, but it has no policyItems. A policy with no 
> policyItems is completely meaningless and it should be deleted.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Updated] (RANGER-2856) A policy should be deleted if it has no policyItems

2020-06-14 Thread RickyMa (Jira)


 [ 
https://issues.apache.org/jira/browse/RANGER-2856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

RickyMa updated RANGER-2856:

Attachment: (was: RANGER-2856.patch)

> A policy should be deleted if it has no policyItems
> ---
>
> Key: RANGER-2856
> URL: https://issues.apache.org/jira/browse/RANGER-2856
> Project: Ranger
>  Issue Type: Bug
>  Components: admin, Ranger
>Affects Versions: master
>Reporter: RickyMa
>Priority: Minor
> Fix For: master
>
> Attachments: RANGER-2856.patch
>
>  Time Spent: 10m
>  Remaining Estimate: 0h
>
> Condition: A policy contains only one policyItem and the policyItem only sets 
> one user and no groups.
> Action: Delete the user in the policyItem using API: 
> '[http://ip:6080/service/xusers/users/\{id}?forceDelete=true'|http://ip:6080/service/xusers/users/id?forceDelete=true%27,]
> Result: The policy still exists, but it has no policyItems. A policy with no 
> policyItems is completely meaningless and it should be deleted.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Updated] (RANGER-2856) A policy should be deleted if it has no policyItems

2020-06-14 Thread RickyMa (Jira)


 [ 
https://issues.apache.org/jira/browse/RANGER-2856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

RickyMa updated RANGER-2856:

Attachment: RANGER-2856.patch

> A policy should be deleted if it has no policyItems
> ---
>
> Key: RANGER-2856
> URL: https://issues.apache.org/jira/browse/RANGER-2856
> Project: Ranger
>  Issue Type: Bug
>  Components: admin, Ranger
>Affects Versions: master
>Reporter: RickyMa
>Priority: Minor
> Fix For: master
>
> Attachments: RANGER-2856.patch
>
>  Time Spent: 10m
>  Remaining Estimate: 0h
>
> Condition: A policy contains only one policyItem and the policyItem only sets 
> one user and no groups.
> Action: Delete the user in the policyItem using API: 
> '[http://ip:6080/service/xusers/users/\{id}?forceDelete=true'|http://ip:6080/service/xusers/users/id?forceDelete=true%27,]
> Result: The policy still exists, but it has no policyItems. A policy with no 
> policyItems is completely meaningless and it should be deleted.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (RANGER-2860) Documentaion to build and install ranger

2020-06-14 Thread Ramesh Mani (Jira)


[ 
https://issues.apache.org/jira/browse/RANGER-2860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17135052#comment-17135052
 ] 

Ramesh Mani commented on RANGER-2860:
-

[~santosh239] Thanks for your contribution.

For the Nifi plugin please refer to the following. Please update here if 
changes are needed.

[https://cwiki.apache.org/confluence/display/RANGER/NiFi+Plugin]

> Documentaion to build and install ranger
> 
>
> Key: RANGER-2860
> URL: https://issues.apache.org/jira/browse/RANGER-2860
> Project: Ranger
>  Issue Type: Improvement
>  Components: documentation
>Affects Versions: 2.0.0
>Reporter: Santosh
>Priority: Major
>
> I am trying to build and install apache ranger 2.0. Looking at the install 
> guide, it is very old and most of the steps including the plugins for nifi 
> and nifi registry install missing. Can you please point me if this is the 
> right location to find it?
> [https://cwiki.apache.org/confluence/display/RANGER/Ranger+Installation+Guide]
>  
> Thanks in advance !!
>  
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)