[
https://issues.apache.org/jira/browse/RANGER-5680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Abhishek Kumar resolved RANGER-5680.
------------------------------------
Fix Version/s: 3.0.0
Resolution: Fixed
Merged in master:
[https://github.com/apache/ranger/commit/d4a0759a4017daee93e91f05983e386448efa14b]
> Restructure audit services in docker compose and use OpenSearch as default
> Index Store
> --------------------------------------------------------------------------------------
>
> Key: RANGER-5680
> URL: https://issues.apache.org/jira/browse/RANGER-5680
> Project: Ranger
> Issue Type: Improvement
> Components: audit
> Reporter: Paras
> Assignee: Abhishek Kumar
> Priority: Major
> Fix For: 3.0.0
>
> Time Spent: 3h 20m
> Remaining Estimate: 0h
>
> Merged via: [PR #1167|https://github.com/apache/ranger/pull/1167]
> h3. Summary
> Consolidated the Ranger docker audit pipeline into
> {{{}docker-compose.ranger-audit-service.yml{}}}. *OpenSearch* (official
> {{{}opensearchproject/opensearch:3.7{}}}) is the default audit index store;
> *Solr* remains available as an alternative. Solr/OpenSearch are only started
> via the audit service, not as standalone stacks.
> h3. Key changes
> * Single audit compose file: ingestor, Kafka, index store (Solr or
> OpenSearch), and matching dispatcher. Removed legacy
> audit-ingestor/dispatcher/solr/opensearch compose files.
> * {{AUDIT_INDEX_STORE}} ({{{}solr{}}} | {{{}opensearch{}}}): selects the
> index store; {{ranger.sh}} sets Ranger Admin {{audit_store}} at setup (no
> manual {{install.properties}} edit).
> * Compose profiles: {{{}audit-store-solr{}}},
> {{{}audit-store-opensearch{}}}, {{{}audit-store-hdfs{}}}; activated via
> {{{}--profile $\{AUDIT_DESTINATIONS{}}}} on the CLI.
> * Optional HDFS fan-out: {{--profile audit-store-hdfs}} with
> {{docker-compose.ranger-audit-destination-hdfs.yml}} (avoids
> {{ranger-hadoop}} merge conflicts in full hive/hbase stacks).
> * Kafka readiness: broker reachable and Ranger plugin policy cache ready
> before ingestor/dispatcher start. Dispatchers depend on ingestor healthy
> (until RANGER-5752 is resolved).
> * CI updated to build/bring up audit services with OpenSearch by default.
> h3. Usage
> *Core stack:*
> {code:bash}
> export RANGER_DB_TYPE=postgres
> export AUDIT_INDEX_STORE=opensearch
> export AUDIT_DESTINATIONS=audit-store-${AUDIT_INDEX_STORE}
> docker compose --profile ${AUDIT_DESTINATIONS} \
> -f docker-compose.ranger.yml \
> -f docker-compose.ranger-audit-service.yml up -d
> {code}
> *HDFS fan-out* (use separate {{-{-}profile{-}}} flags; commas are not split
> in a single {{{}-profile{}}}):
> {code:bash}
> docker compose \
> --profile audit-store-${AUDIT_INDEX_STORE} \
> --profile audit-store-hdfs \
> -f docker-compose.ranger.yml \
> -f docker-compose.ranger-audit-service.yml \
> -f docker-compose.ranger-audit-destination-hdfs.yml up -d
> {code}
> h3. Verification
> * CI passing
> * Manual bring-up with OpenSearch and Solr
> * Audits verified flowing to OpenSearch / Solr / HDFS
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
