-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/73717/
-----------------------------------------------------------
(Updated Nov. 30, 2021, 1:32 p.m.)
Review request for ranger, Abhay Kulkarni, Madhan Neethiraj, Mehul Parikh,
Pradeep Agrawal, Ramesh Mani, Sailaja Polavarapu, and Velmurugan Periasamy.
Bugs: RANGER-3518
https://issues.apache.org/jira/browse/RANGER-3518
Repository: ranger
Description
-------
Ranger audit stores complete query as it is in audit logs. If the single query
size is too large (i.e reqData > 10MB) it consumes large heap size on hive
plugin size. When similar 200-300 queries are executed simultaneously, ranger
audit takes up more than half of the heap.
With this patch we can configure size of the request data stored in audit logs.
We can set value for config "xasecure.audit.solr.limit.query.req.size" in
ranger-hive-audit.xml
Recommended value is 1024; however default value is set to Integer.MAX_VALUE
Diffs (updated)
-----
hive-agent/src/main/java/org/apache/ranger/authorization/hive/authorizer/RangerHiveAuditHandler.java
5c04bdb69
hive-agent/src/main/java/org/apache/ranger/authorization/hive/authorizer/RangerHiveAuthorizer.java
2be442460
Diff: https://reviews.apache.org/r/73717/diff/2/
Changes: https://reviews.apache.org/r/73717/diff/1-2/
Testing
-------
BUILD SUCCESS: mvn clean compile verify test install
Ranger installation and setup successful.
Generated large hive queries and validated that audits in spool file stores
query size equal to the value mentioned in config
"xasecure.audit.solr.limit.query.req.size"
Thanks,
Mahesh Bandal
