[ 
https://issues.apache.org/jira/browse/RANGER-2732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17645581#comment-17645581
 ] 

Ramachandran edited comment on RANGER-2732 at 12/10/22 2:01 PM:
----------------------------------------------------------------

[~pradeep]  [[email protected]]  After going through this patch I feel this 
will give a better performance when a policy contains more 
users,groups,policies 

A similar kind of improvement we did in the below PR and it is in review 

https://issues.apache.org/jira/browse/RANGER-3899

Review:[https://reviews.apache.org/r/74245/]

I am planning to integrate this fix also into RANGER-3899 

 

Before fixing (RANGER-3899 )

 

The policy contains 500 users,5 access Types (permissions),12 resources 
(1DB,1Table,10 columns)
||DB Write count||DB Read count||DB Batch Write count||Time is taken to create 
the policy||
|504|526|3|4~8 seconds|

 

After  fixing (RANGER-3899 )

When Policy contains 500 users,5 access Types (permissions),12 resources 
(1DB,1Table,10 columns)

       
||DB Write count||DB Read count||DB Batch Write count||Time is taken to create 
the policy||
|6|526|5|2.6~3.5 seconds|

 

After  fixing (RANGER-3899, RANGER-2732,)

When Policy contains 500 users,5 access Types (permissions),12 resources 
(1DB,1Table,10 columns)

After the Batch read the calls will be reduced into 
||DB Write count||DB Read count||DB Batch Write count||Time is taken to create 
the policy||
|6|27|5|<2.6 seconds (needs to be validated)|

DB read calls will be reduced to {color:#de350b}27{color} from 
{color:#403294}526{color}

 


was (Author: JIRAUSER295265):
[~pradeep]  [[email protected]]  After going through this patch I feel this 
will give a better performance when a policy contains more 
users,groups,policies 

A similar kind of improvement we did in the below PR and it is in review 

https://issues.apache.org/jira/browse/RANGER-3899

Review:[https://reviews.apache.org/r/74245/]

I am planning to integrate this fix also into RANGER-3899 

 

> Batch lookup role, group, and user IDs during policy creation
> -------------------------------------------------------------
>
>                 Key: RANGER-2732
>                 URL: https://issues.apache.org/jira/browse/RANGER-2732
>             Project: Ranger
>          Issue Type: Improvement
>          Components: admin
>    Affects Versions: master
>            Reporter: Andrew Luo
>            Priority: Major
>         Attachments: 
> 0001-RANGER-2732-Batch-lookup-role-group-and-user-IDs-during-policy-c.patch
>
>
> Getting the ID for each role/group/user one-by-one is slow, especially for 
> large policies with many roles/groups/users.  Batching significantly improves 
> performance.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to