[
https://issues.apache.org/jira/browse/RANGER-5633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18088442#comment-18088442
]
Ramachandran Krishnan commented on RANGER-5633:
-----------------------------------------------
Merged in
master:https://github.com/apache/ranger/commit/4a061759b417e23a9ea46564681fc384166dfe35
> Audit-server Kafka tuning (producer, consumer, topic)
> -----------------------------------------------------
>
> Key: RANGER-5633
> URL: https://issues.apache.org/jira/browse/RANGER-5633
> Project: Ranger
> Issue Type: Task
> Components: audit, Ranger
> Reporter: Ramachandran Krishnan
> Assignee: Ramachandran Krishnan
> Priority: Major
> Fix For: 3.0.0
>
> Attachments: Kafka consumers_ Solr + HDFS audit dispatchers.pdf,
> Kafka producer performance (audit-ingestor).pdf, Ranger Audit Server and
> Kafka_ KRaft vs ZooKeeper (3.9.1 Recommendation).pdf
>
> Time Spent: 0.5h
> Remaining Estimate: 0h
>
> Kafka producer and consumer configuration gaps in the audit-server stack:
> * *Ingestor producer* — wire {{{}batch.size{}}}, {{{}linger.ms{}}},
> {{{}buffer.memory{}}}, {{{}compression.type{}}}, timeouts, and related
> {{ProducerConfig}} keys from site XML; {{flush()}} on shutdown; configurable
> REST batch send timeout.
> * *Dispatchers* — default to {{{}CooperativeStickyAssignor{}}}; document and
> ship consumer rebalance/poll timeout properties in Solr and HDFS site XML.
> * *Topic creation* — optionally apply {{{}retention.ms{}}},
> {{{}compression.type{}}}, and {{min.insync.replicas}} when Ranger creates the
> {{ranger_audits}} topic.
> All new properties are {*}backward compatible{*}: code defaults apply when
> site XML omits them.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
