[
https://issues.apache.org/jira/browse/RANGER-2732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17645581#comment-17645581
]
Ramachandran edited comment on RANGER-2732 at 12/10/22 2:01 PM:
----------------------------------------------------------------
[~pradeep] [[email protected]] After going through this patch I feel this
will give a better performance when a policy contains more
users,groups,policies
A similar kind of improvement we did in the below PR and it is in review
https://issues.apache.org/jira/browse/RANGER-3899
Review:[https://reviews.apache.org/r/74245/]
I am planning to integrate this fix also into RANGER-3899
Before fixing (RANGER-3899 )
The policy contains 500 users,5 access Types (permissions),12 resources
(1DB,1Table,10 columns)
||DB Write count||DB Read count||DB Batch Write count||Time is taken to create
the policy||
|504|526|3|4~8 seconds|
After fixing (RANGER-3899 )
When Policy contains 500 users,5 access Types (permissions),12 resources
(1DB,1Table,10 columns)
||DB Write count||DB Read count||DB Batch Write count||Time is taken to create
the policy||
|6|526|5|2.6~3.5 seconds|
After fixing (RANGER-3899, RANGER-2732,)
When Policy contains 500 users,5 access Types (permissions),12 resources
(1DB,1Table,10 columns)
After the Batch read the calls will be reduced into
||DB Write count||DB Read count||DB Batch Write count||Time is taken to create
the policy||
|6|27|5|<2.6 seconds (needs to be validated)|
DB read calls will be reduced to {color:#de350b}27{color} from
{color:#403294}526{color}
was (Author: JIRAUSER295265):
[~pradeep] [[email protected]] After going through this patch I feel this
will give a better performance when a policy contains more
users,groups,policies
A similar kind of improvement we did in the below PR and it is in review
https://issues.apache.org/jira/browse/RANGER-3899
Review:[https://reviews.apache.org/r/74245/]
I am planning to integrate this fix also into RANGER-3899
> Batch lookup role, group, and user IDs during policy creation
> -------------------------------------------------------------
>
> Key: RANGER-2732
> URL: https://issues.apache.org/jira/browse/RANGER-2732
> Project: Ranger
> Issue Type: Improvement
> Components: admin
> Affects Versions: master
> Reporter: Andrew Luo
> Priority: Major
> Attachments:
> 0001-RANGER-2732-Batch-lookup-role-group-and-user-IDs-during-policy-c.patch
>
>
> Getting the ID for each role/group/user one-by-one is slow, especially for
> large policies with many roles/groups/users. Batching significantly improves
> performance.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)