-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/75138/
-----------------------------------------------------------
Review request for ranger, Abhishek Kumar, Asit Vadhavkar, Fateh Singh, Kishor
Gollapalliwar, Abhay Kulkarni, Mehul Parikh, Pradeep Agrawal, Ramesh Mani,
Sailaja Polavarapu, Subhrat Chaudhary, and Vyom Tiwari.
Bugs: RANGER-4889
https://issues.apache.org/jira/browse/RANGER-4889
Repository: ranger
Description
-------
- updated RangerMemSizing tool with addition of following options
-q requests-file -> generates the specified file containing access-requests
for all the resources referenced in the given policies and tags
-e requests-file -> evaluates access-requests in the specified file in a
plugin instance created with the given policies and tags
-c client-count -> number of access clients to evaluate the requests
Diffs
-----
ranger-tools/src/main/java/org/apache/ranger/sizing/PerfRequestGenerator.java
PRE-CREATION
ranger-tools/src/main/java/org/apache/ranger/sizing/RangerMemSizing.java
695bfc211
Diff: https://reviews.apache.org/r/75138/diff/1/
Testing
-------
- ranger-mem-sizing.sh -d true -p service_policies.json -t service_tags.json -r
ranger_roles.json -q requests.json
```
Parameters:
Policies: file=service_policies.json, size=543946, policyCount=544
Tags: file=service_tags.json, size=302113514, tagDefCount=106,
tagCount=131, resourceCount=639340
Roles: file=ranger_roles.json, size=587515, roleCount=997
GenReq: file=requests.json, requestCount=639364
DeDup: true
OptMode: retrieval
Results:
*****************************
Task|Time (ms)|Memory (bytes)
RangerMemSizing|10835|1708449216
Load policies|174|2063576
Read policies|168|6938800
DeDupStrings|5|-361360
Load tags|1206|684289120
Read tags|914|821228648
DeDupTags|109|26536
DeDupStrings|183|-136923632
Load roles|30|1583976
RangerBasePlugin initialization|8608|1024102264
generateRequests|783|407613272
*****************************
```
- ranger-mem-sizing.sh -d true -p service_policies.json -t service_tags.json -r
ranger_roles.json -e requests.json -c 12
```
Parameters:
Policies: file=service_policies.json, size=543946, policyCount=544
Tags: file=service_tags.json, size=302113514, tagDefCount=106,
tagCount=131, resourceCount=639340
Roles: file=ranger_roles.json, size=587515, roleCount=997
EvalReq: file=requests.json, requestCount=639364, avgTimeTaken=25100ns,
clientCount=12
DeDup: true
OptMode: retrieval
Results:
*****************************
Task|Time (ms)|Memory (bytes)
RangerMemSizing|25977|1717696472
Load policies|175|2062696
Read policies|167|6939200
DeDupStrings|6|-362824
Load tags|1152|684288872
Read tags|871|821228400
DeDupTags|105|26536
DeDupStrings|176|-136923632
Load roles|31|1583656
RangerBasePlugin initialization|8598|1024102024
evaluateRequests|16813|9982376
readRequests|562|785950888
*****************************
```
Thanks,
Madhan Neethiraj
