-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/75138/#review226796
-----------------------------------------------------------


Ship it!




Ship It!

- Abhay Kulkarni


On Aug. 6, 2024, 5:13 a.m., Madhan Neethiraj wrote:
> 
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/75138/
> -----------------------------------------------------------
> 
> (Updated Aug. 6, 2024, 5:13 a.m.)
> 
> 
> Review request for ranger, Abhishek  Kumar, Asit Vadhavkar, Fateh Singh, 
> Kishor Gollapalliwar, Abhay Kulkarni, Mehul Parikh, Pradeep Agrawal, Ramesh 
> Mani, Sailaja Polavarapu, Subhrat Chaudhary, and Vyom Tiwari.
> 
> 
> Bugs: RANGER-4889
>     https://issues.apache.org/jira/browse/RANGER-4889
> 
> 
> Repository: ranger
> 
> 
> Description
> -------
> 
> - updated RangerMemSizing tool with addition of following options 
>  -q requests-file -> generates the specified file containing access-requests 
> for all the resources referenced in the given policies and tags
>  -e requests-file -> evaluates access-requests in the specified file in a 
> plugin instance created with the given policies and tags
>  -c client-count  -> number of access clients to evaluate the requests
> 
> 
> Diffs
> -----
> 
>   
> ranger-tools/src/main/java/org/apache/ranger/sizing/PerfRequestGenerator.java 
> PRE-CREATION 
>   ranger-tools/src/main/java/org/apache/ranger/sizing/RangerMemSizing.java 
> 695bfc211 
> 
> 
> Diff: https://reviews.apache.org/r/75138/diff/1/
> 
> 
> Testing
> -------
> 
> - ranger-mem-sizing.sh -d true -p service_policies.json -t service_tags.json 
> -r ranger_roles.json -q requests.json
> ```
> Parameters:
>   Policies:  file=service_policies.json, size=543946, policyCount=544
>   Tags:      file=service_tags.json, size=302113514, tagDefCount=106, 
> tagCount=131, resourceCount=639340
>   Roles:     file=ranger_roles.json, size=587515, roleCount=997
>   GenReq:    file=requests.json, requestCount=639364
>   DeDup:     true
>   OptMode:   retrieval
> 
> Results:
> *****************************
> Task|Time (ms)|Memory (bytes)
> RangerMemSizing|10835|1708449216
>   Load policies|174|2063576
>     Read policies|168|6938800
>     DeDupStrings|5|-361360
>   Load tags|1206|684289120
>     Read tags|914|821228648
>     DeDupTags|109|26536
>     DeDupStrings|183|-136923632
>   Load roles|30|1583976
>   RangerBasePlugin initialization|8608|1024102264
>   generateRequests|783|407613272
> *****************************
> ```
> - ranger-mem-sizing.sh -d true -p service_policies.json -t service_tags.json 
> -r ranger_roles.json -e requests.json -c 12
> ```
> Parameters:
>   Policies:  file=service_policies.json, size=543946, policyCount=544
>   Tags:      file=service_tags.json, size=302113514, tagDefCount=106, 
> tagCount=131, resourceCount=639340
>   Roles:     file=ranger_roles.json, size=587515, roleCount=997
>   EvalReq:   file=requests.json, requestCount=639364, avgTimeTaken=25100ns, 
> clientCount=12
>   DeDup:     true
>   OptMode:   retrieval
> 
> Results:
> *****************************
> Task|Time (ms)|Memory (bytes)
> RangerMemSizing|25977|1717696472
>   Load policies|175|2062696
>     Read policies|167|6939200
>     DeDupStrings|6|-362824
>   Load tags|1152|684288872
>     Read tags|871|821228400
>     DeDupTags|105|26536
>     DeDupStrings|176|-136923632
>   Load roles|31|1583656
>   RangerBasePlugin initialization|8598|1024102024
>   evaluateRequests|16813|9982376
>     readRequests|562|785950888
> *****************************
> ```
> 
> 
> Thanks,
> 
> Madhan Neethiraj
> 
>

Reply via email to