Ramachandran Krishnan created RANGER-5633:
---------------------------------------------

             Summary: Audit-server Kafka tuning (producer, consumer, topic)
                 Key: RANGER-5633
                 URL: https://issues.apache.org/jira/browse/RANGER-5633
             Project: Ranger
          Issue Type: Task
          Components: audit, Ranger
            Reporter: Ramachandran Krishnan
            Assignee: Ramachandran Krishnan
             Fix For: 3.0.0


Kafka producer and consumer configuration gaps in the audit-server stack:
 * *Ingestor producer* — wire {{{}batch.size{}}}, {{{}linger.ms{}}}, 
{{{}buffer.memory{}}}, {{{}compression.type{}}}, timeouts, and related 
{{ProducerConfig}} keys from site XML; {{flush()}} on shutdown; configurable 
REST batch send timeout.

 * *Dispatchers* — default to {{{}CooperativeStickyAssignor{}}}; document and 
ship consumer rebalance/poll timeout properties in Solr and HDFS site XML.

 * *Topic creation* — optionally apply {{{}retention.ms{}}}, 
{{{}compression.type{}}}, and {{min.insync.replicas}} when Ranger creates the 
{{ranger_audits}} topic.

All new properties are {*}backward compatible{*}: code defaults apply when site 
XML omits them.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to