[jira] [Created] (RANGER-3328) RANGER-KMS : code improvement
Mateen N Mansoori created RANGER-3328: - Summary: RANGER-KMS : code improvement Key: RANGER-3328 URL: https://issues.apache.org/jira/browse/RANGER-3328 Project: Ranger Issue Type: Improvement Components: Ranger Reporter: Mateen N Mansoori The following Hadoop kms changes need to be ported in ranger-kms : [HADOOP-14784|https://issues.apache.org/jira/browse/HADOOP-14784] [HADOOP-15234|https://issues.apache.org/jira/browse/HADOOP-15234] [HADOOP-15455|https://issues.apache.org/jira/browse/HADOOP-15455] -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (RANGER-3327) List of services in "Security Zones" is not full
[ https://issues.apache.org/jira/browse/RANGER-3327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17376758#comment-17376758 ] Nitin Galave commented on RANGER-3327: -- Hi [~fullhouse], We allow only the first 100 services in the security zone Select Resources services field in the older ranger version. This was updated to 200 in [RANGER-2762|https://issues.apache.org/jira/browse/RANGER-2767]. Thanks, Nitin > List of services in "Security Zones" is not full > > > Key: RANGER-3327 > URL: https://issues.apache.org/jira/browse/RANGER-3327 > Project: Ranger > Issue Type: Bug > Components: admin >Affects Versions: 2.0.0, 2.1.0, 3.0.0, 2.2.0 >Reporter: Konstantin Tsypin >Priority: Major > Attachments: image-2021-07-07-17-49-59-777.png, > image-2021-07-07-17-49-59-815.png, image-2021-07-07-17-50-20-612.png, > image-2021-07-07-17-50-39-688.png, image-2021-07-07-17-50-39-729.png > > > Hi there. We have about N hundreds services on Apache Ranger main page. > So in security zones we didnot see all services, it's snap of some first > added. > Look at the screenshots. Seemed like problem with pagelisting or something > like that. > 1) Services: > !image-2021-07-07-17-40-13-671.png! > 2) Security zones performance: > !image-2021-07-07-17-41-52-133.png! > The tag choice does not change any (look screens on task comment) -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (RANGER-3327) List of services in "Security Zones" is not full
[ https://issues.apache.org/jira/browse/RANGER-3327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Tsypin updated RANGER-3327: -- Description: Hi there. We have about N hundreds services on Apache Ranger main page. So in security zones we didnot see all services, it's snap of some first added. Look at the screenshots. Seemed like problem with pagelisting or something like that. 1) Services: !image-2021-07-07-17-40-13-671.png! 2) Security zones performance: !image-2021-07-07-17-41-52-133.png! The tag choice does not change any (look screens on task comment) was: Hi there. We have about N hundreds services on Apache Ranger main page. So in security zones we didnot see all services, it's snap of some first 5 added. Look at the screenshots. Seemed like problem with pagelisting or something like that. 1) Services: !image-2021-07-07-17-40-13-671.png! 2) Security zones performance: !image-2021-07-07-17-41-52-133.png! The tag choice does not change any (look screens on task comment) > List of services in "Security Zones" is not full > > > Key: RANGER-3327 > URL: https://issues.apache.org/jira/browse/RANGER-3327 > Project: Ranger > Issue Type: Bug > Components: admin >Affects Versions: 2.0.0, 2.1.0, 3.0.0, 2.2.0 >Reporter: Konstantin Tsypin >Priority: Major > Attachments: image-2021-07-07-17-49-59-777.png, > image-2021-07-07-17-49-59-815.png, image-2021-07-07-17-50-20-612.png, > image-2021-07-07-17-50-39-688.png, image-2021-07-07-17-50-39-729.png > > > Hi there. We have about N hundreds services on Apache Ranger main page. > So in security zones we didnot see all services, it's snap of some first > added. > Look at the screenshots. Seemed like problem with pagelisting or something > like that. > 1) Services: > !image-2021-07-07-17-40-13-671.png! > 2) Security zones performance: > !image-2021-07-07-17-41-52-133.png! > The tag choice does not change any (look screens on task comment) -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (RANGER-3327) List of services in "Security Zones" is not full
[ https://issues.apache.org/jira/browse/RANGER-3327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17376638#comment-17376638 ] Konstantin Tsypin commented on RANGER-3327: --- [~abhayk] [~abhay] May be you can help with this? > List of services in "Security Zones" is not full > > > Key: RANGER-3327 > URL: https://issues.apache.org/jira/browse/RANGER-3327 > Project: Ranger > Issue Type: Bug > Components: admin >Affects Versions: 2.0.0, 2.1.0, 3.0.0, 2.2.0 >Reporter: Konstantin Tsypin >Priority: Major > Attachments: image-2021-07-07-17-49-59-777.png, > image-2021-07-07-17-49-59-815.png, image-2021-07-07-17-50-20-612.png, > image-2021-07-07-17-50-39-688.png, image-2021-07-07-17-50-39-729.png > > > Hi there. We have about N hundreds services on Apache Ranger main page. > So in security zones we didnot see all services, it's snap of some first 5 > added. > Look at the screenshots. Seemed like problem with pagelisting or something > like that. > 1) Services: > !image-2021-07-07-17-40-13-671.png! > 2) Security zones performance: > !image-2021-07-07-17-41-52-133.png! > The tag choice does not change any (look screens on task comment) -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (RANGER-3327) List of services in "Security Zones" is not full
[ https://issues.apache.org/jira/browse/RANGER-3327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Tsypin updated RANGER-3327: -- Description: Hi there. We have about N hundreds services on Apache Ranger main page. So in security zones we didnot see all services, it's snap of some first 5 added. Look at the screenshots. Seemed like problem with pagelisting or something like that. 1) Services: !image-2021-07-07-17-40-13-671.png! 2) Security zones performance: !image-2021-07-07-17-41-52-133.png! TThe tag choice does not change any (look screens on task comment) was: Hi there. We have about N hundreds services on Apache Ranger main page. So in security zones we didnot see all services, it's snap of some first 5 added. Look at the screenshots. Seemed like problem with pagelisting or something like that. 1) Services: !image-2021-07-07-17-40-13-671.png! 2) Security zones performance: !image-2021-07-07-17-41-52-133.png! TThe tag choice does not change any > List of services in "Security Zones" is not full > > > Key: RANGER-3327 > URL: https://issues.apache.org/jira/browse/RANGER-3327 > Project: Ranger > Issue Type: Bug > Components: admin >Affects Versions: 2.0.0, 2.1.0, 3.0.0, 2.2.0 >Reporter: Konstantin Tsypin >Priority: Major > Attachments: image-2021-07-07-17-49-59-777.png, > image-2021-07-07-17-49-59-815.png, image-2021-07-07-17-50-20-612.png, > image-2021-07-07-17-50-39-688.png, image-2021-07-07-17-50-39-729.png > > > Hi there. We have about N hundreds services on Apache Ranger main page. > So in security zones we didnot see all services, it's snap of some first 5 > added. > Look at the screenshots. Seemed like problem with pagelisting or something > like that. > 1) Services: > !image-2021-07-07-17-40-13-671.png! > 2) Security zones performance: > !image-2021-07-07-17-41-52-133.png! > TThe tag choice does not change any (look screens on task comment) -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (RANGER-3327) List of services in "Security Zones" is not full
[ https://issues.apache.org/jira/browse/RANGER-3327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Tsypin updated RANGER-3327: -- Description: Hi there. We have about N hundreds services on Apache Ranger main page. So in security zones we didnot see all services, it's snap of some first 5 added. Look at the screenshots. Seemed like problem with pagelisting or something like that. 1) Services: !image-2021-07-07-17-40-13-671.png! 2) Security zones performance: !image-2021-07-07-17-41-52-133.png! The tag choice does not change any (look screens on task comment) was: Hi there. We have about N hundreds services on Apache Ranger main page. So in security zones we didnot see all services, it's snap of some first 5 added. Look at the screenshots. Seemed like problem with pagelisting or something like that. 1) Services: !image-2021-07-07-17-40-13-671.png! 2) Security zones performance: !image-2021-07-07-17-41-52-133.png! TThe tag choice does not change any (look screens on task comment) > List of services in "Security Zones" is not full > > > Key: RANGER-3327 > URL: https://issues.apache.org/jira/browse/RANGER-3327 > Project: Ranger > Issue Type: Bug > Components: admin >Affects Versions: 2.0.0, 2.1.0, 3.0.0, 2.2.0 >Reporter: Konstantin Tsypin >Priority: Major > Attachments: image-2021-07-07-17-49-59-777.png, > image-2021-07-07-17-49-59-815.png, image-2021-07-07-17-50-20-612.png, > image-2021-07-07-17-50-39-688.png, image-2021-07-07-17-50-39-729.png > > > Hi there. We have about N hundreds services on Apache Ranger main page. > So in security zones we didnot see all services, it's snap of some first 5 > added. > Look at the screenshots. Seemed like problem with pagelisting or something > like that. > 1) Services: > !image-2021-07-07-17-40-13-671.png! > 2) Security zones performance: > !image-2021-07-07-17-41-52-133.png! > The tag choice does not change any (look screens on task comment) -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (RANGER-3327) List of services in "Security Zones" is not full
[ https://issues.apache.org/jira/browse/RANGER-3327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17376615#comment-17376615 ] Konstantin Tsypin commented on RANGER-3327: --- screen1: !image-2021-07-07-17-50-20-651.png!!image-2021-07-07-17-50-20-612.png! screen2: !image-2021-07-07-17-50-39-729.png! Where is all my services? > List of services in "Security Zones" is not full > > > Key: RANGER-3327 > URL: https://issues.apache.org/jira/browse/RANGER-3327 > Project: Ranger > Issue Type: Bug > Components: admin >Affects Versions: 2.0.0, 2.1.0, 3.0.0, 2.2.0 >Reporter: Konstantin Tsypin >Priority: Major > Attachments: image-2021-07-07-17-49-59-777.png, > image-2021-07-07-17-49-59-815.png, image-2021-07-07-17-50-20-612.png, > image-2021-07-07-17-50-39-688.png, image-2021-07-07-17-50-39-729.png > > > Hi there. We have about N hundreds services on Apache Ranger main page. > So in security zones we didnot see all services, it's snap of some first 5 > added. > Look at the screenshots. Seemed like problem with pagelisting or something > like that. > 1) Services: > !image-2021-07-07-17-40-13-671.png! > 2) Security zones performance: > !image-2021-07-07-17-41-52-133.png! > TThe tag choice does not change any -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Comment Edited] (RANGER-3327) List of services in "Security Zones" is not full
[ https://issues.apache.org/jira/browse/RANGER-3327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17376615#comment-17376615 ] Konstantin Tsypin edited comment on RANGER-3327 at 7/7/21, 2:50 PM: screen1: !image-2021-07-07-17-50-20-612.png! screen2: !image-2021-07-07-17-50-39-729.png! Where is all my services? was (Author: fullhouse): screen1: !image-2021-07-07-17-50-20-651.png!!image-2021-07-07-17-50-20-612.png! screen2: !image-2021-07-07-17-50-39-729.png! Where is all my services? > List of services in "Security Zones" is not full > > > Key: RANGER-3327 > URL: https://issues.apache.org/jira/browse/RANGER-3327 > Project: Ranger > Issue Type: Bug > Components: admin >Affects Versions: 2.0.0, 2.1.0, 3.0.0, 2.2.0 >Reporter: Konstantin Tsypin >Priority: Major > Attachments: image-2021-07-07-17-49-59-777.png, > image-2021-07-07-17-49-59-815.png, image-2021-07-07-17-50-20-612.png, > image-2021-07-07-17-50-39-688.png, image-2021-07-07-17-50-39-729.png > > > Hi there. We have about N hundreds services on Apache Ranger main page. > So in security zones we didnot see all services, it's snap of some first 5 > added. > Look at the screenshots. Seemed like problem with pagelisting or something > like that. > 1) Services: > !image-2021-07-07-17-40-13-671.png! > 2) Security zones performance: > !image-2021-07-07-17-41-52-133.png! > TThe tag choice does not change any -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (RANGER-3327) List of services in "Security Zones" is not full
[ https://issues.apache.org/jira/browse/RANGER-3327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Tsypin updated RANGER-3327: -- Attachment: image-2021-07-07-17-50-39-688.png > List of services in "Security Zones" is not full > > > Key: RANGER-3327 > URL: https://issues.apache.org/jira/browse/RANGER-3327 > Project: Ranger > Issue Type: Bug > Components: admin >Affects Versions: 2.0.0, 2.1.0, 3.0.0, 2.2.0 >Reporter: Konstantin Tsypin >Priority: Major > Attachments: image-2021-07-07-17-49-59-777.png, > image-2021-07-07-17-49-59-815.png, image-2021-07-07-17-50-20-612.png, > image-2021-07-07-17-50-39-688.png, image-2021-07-07-17-50-39-729.png > > > Hi there. We have about N hundreds services on Apache Ranger main page. > So in security zones we didnot see all services, it's snap of some first 5 > added. > Look at the screenshots. Seemed like problem with pagelisting or something > like that. > 1) Services: > !image-2021-07-07-17-40-13-671.png! > 2) Security zones performance: > !image-2021-07-07-17-41-52-133.png! > TThe tag choice does not change any -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (RANGER-3327) List of services in "Security Zones" is not full
[ https://issues.apache.org/jira/browse/RANGER-3327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Tsypin updated RANGER-3327: -- Attachment: image-2021-07-07-17-50-20-612.png > List of services in "Security Zones" is not full > > > Key: RANGER-3327 > URL: https://issues.apache.org/jira/browse/RANGER-3327 > Project: Ranger > Issue Type: Bug > Components: admin >Affects Versions: 2.0.0, 2.1.0, 3.0.0, 2.2.0 >Reporter: Konstantin Tsypin >Priority: Major > Attachments: image-2021-07-07-17-49-59-777.png, > image-2021-07-07-17-49-59-815.png, image-2021-07-07-17-50-20-612.png, > image-2021-07-07-17-50-39-688.png, image-2021-07-07-17-50-39-729.png > > > Hi there. We have about N hundreds services on Apache Ranger main page. > So in security zones we didnot see all services, it's snap of some first 5 > added. > Look at the screenshots. Seemed like problem with pagelisting or something > like that. > 1) Services: > !image-2021-07-07-17-40-13-671.png! > 2) Security zones performance: > !image-2021-07-07-17-41-52-133.png! > TThe tag choice does not change any -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (RANGER-3327) List of services in "Security Zones" is not full
[ https://issues.apache.org/jira/browse/RANGER-3327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Tsypin updated RANGER-3327: -- Attachment: image-2021-07-07-17-49-59-815.png > List of services in "Security Zones" is not full > > > Key: RANGER-3327 > URL: https://issues.apache.org/jira/browse/RANGER-3327 > Project: Ranger > Issue Type: Bug > Components: admin >Affects Versions: 2.0.0, 2.1.0, 3.0.0, 2.2.0 >Reporter: Konstantin Tsypin >Priority: Major > Attachments: image-2021-07-07-17-49-59-777.png, > image-2021-07-07-17-49-59-815.png, image-2021-07-07-17-50-20-612.png, > image-2021-07-07-17-50-39-688.png, image-2021-07-07-17-50-39-729.png > > > Hi there. We have about N hundreds services on Apache Ranger main page. > So in security zones we didnot see all services, it's snap of some first 5 > added. > Look at the screenshots. Seemed like problem with pagelisting or something > like that. > 1) Services: > !image-2021-07-07-17-40-13-671.png! > 2) Security zones performance: > !image-2021-07-07-17-41-52-133.png! > TThe tag choice does not change any -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (RANGER-3327) List of services in "Security Zones" is not full
[ https://issues.apache.org/jira/browse/RANGER-3327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Tsypin updated RANGER-3327: -- Attachment: image-2021-07-07-17-50-39-729.png > List of services in "Security Zones" is not full > > > Key: RANGER-3327 > URL: https://issues.apache.org/jira/browse/RANGER-3327 > Project: Ranger > Issue Type: Bug > Components: admin >Affects Versions: 2.0.0, 2.1.0, 3.0.0, 2.2.0 >Reporter: Konstantin Tsypin >Priority: Major > Attachments: image-2021-07-07-17-49-59-777.png, > image-2021-07-07-17-49-59-815.png, image-2021-07-07-17-50-20-612.png, > image-2021-07-07-17-50-39-688.png, image-2021-07-07-17-50-39-729.png > > > Hi there. We have about N hundreds services on Apache Ranger main page. > So in security zones we didnot see all services, it's snap of some first 5 > added. > Look at the screenshots. Seemed like problem with pagelisting or something > like that. > 1) Services: > !image-2021-07-07-17-40-13-671.png! > 2) Security zones performance: > !image-2021-07-07-17-41-52-133.png! > TThe tag choice does not change any -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (RANGER-3327) List of services in "Security Zones" is not full
[ https://issues.apache.org/jira/browse/RANGER-3327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Tsypin updated RANGER-3327: -- Attachment: image-2021-07-07-17-49-59-777.png > List of services in "Security Zones" is not full > > > Key: RANGER-3327 > URL: https://issues.apache.org/jira/browse/RANGER-3327 > Project: Ranger > Issue Type: Bug > Components: admin >Affects Versions: 2.0.0, 2.1.0, 3.0.0, 2.2.0 >Reporter: Konstantin Tsypin >Priority: Major > Attachments: image-2021-07-07-17-49-59-777.png, > image-2021-07-07-17-49-59-815.png, image-2021-07-07-17-50-20-612.png, > image-2021-07-07-17-50-39-688.png, image-2021-07-07-17-50-39-729.png > > > Hi there. We have about N hundreds services on Apache Ranger main page. > So in security zones we didnot see all services, it's snap of some first 5 > added. > Look at the screenshots. Seemed like problem with pagelisting or something > like that. > 1) Services: > !image-2021-07-07-17-40-13-671.png! > 2) Security zones performance: > !image-2021-07-07-17-41-52-133.png! > TThe tag choice does not change any -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (RANGER-3327) List of services in "Security Zones" is not full
Konstantin Tsypin created RANGER-3327: - Summary: List of services in "Security Zones" is not full Key: RANGER-3327 URL: https://issues.apache.org/jira/browse/RANGER-3327 Project: Ranger Issue Type: Bug Components: admin Affects Versions: 2.1.0, 2.0.0, 3.0.0, 2.2.0 Reporter: Konstantin Tsypin Hi there. We have about N hundreds services on Apache Ranger main page. So in security zones we didnot see all services, it's snap of some first 5 added. Look at the screenshots. Seemed like problem with pagelisting or something like that. 1) Services: !image-2021-07-07-17-40-13-671.png! 2) Security zones performance: !image-2021-07-07-17-41-52-133.png! TThe tag choice does not change any -- This message was sent by Atlassian Jira (v8.3.4#803005)
Re: Review Request 72949: RANGER-3024: Improve response time and refactor code for GET API /service/xusers/lookup/users
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/72949/ --- (Updated July 7, 2021, 1:56 p.m.) Review request for ranger, Ankita Sinha, Dhaval Shah, Gautam Borad, Kishor Gollapalliwar, Abhay Kulkarni, Madhan Neethiraj, Mehul Parikh, Pradeep Agrawal, Ramesh Mani, Sailaja Polavarapu, and Velmurugan Periasamy. Bugs: RANGER-3024 https://issues.apache.org/jira/browse/RANGER-3024 Repository: ranger Description --- GET API /service/xusers/lookup/users returns List of String object which contains username. But it also traverse through groupUser list while populating view object VXUser. When there are large number of users and group_users data in database; it takes longer time to respond if we set request parameter pageSize=1000 or more. This causes performance issue. So created a new method lookupXUsers which will search for users based on searchCriteria and map user entity to view object. It will not traverse through groupUsers. Diffs (updated) - security-admin/src/main/java/org/apache/ranger/biz/XUserMgr.java 624232644 security-admin/src/main/java/org/apache/ranger/rest/XUserREST.java 739809c0d security-admin/src/main/java/org/apache/ranger/service/XUserService.java 856690534 Diff: https://reviews.apache.org/r/72949/diff/2/ Changes: https://reviews.apache.org/r/72949/diff/1-2/ Testing --- GET request for /service/xusers/lookup/users API returns response instantaneously even with request parameter pageSize=5. Tested with following stats : select count(*) from x_user; 50052 select count(*) from x_group_users; 500056 Thanks, Mahesh Bandal
