[
https://issues.apache.org/jira/browse/IMPALA-13112?focusedWorklogId=921185&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-921185
]
ASF GitHub Bot logged work on IMPALA-13112:
-------------------------------------------
Author: ASF GitHub Bot
Created on: 29/May/24 08:22
Start Date: 29/May/24 08:22
Worklog Time Spent: 10m
Work Description: dntjr8096 opened a new pull request, #75:
URL: https://github.com/apache/impala/pull/75
**Issue** : https://issues.apache.org/jira/browse/IMPALA-13112
**Testing Environment:**
The changes were tested in the following environment:
- Impala Version: 4.1.1
- Ranger Version: 2.3.0
**Results:**
The tests confirmed that with the Kafka dependency exclusion removed:
Impala started successfully without any java.lang.NoClassDefFoundError
errors related to javax.ws.rs.
Ranger's Kafka-based audit logging functioned correctly with the Kafka
client included.
This change is expected to improve the integration between Impala and Ranger
by enabling Kafka-based audit logging without reintroducing previous conflicts.
Issue Time Tracking
-------------------
Worklog Id: (was: 921185)
Remaining Estimate: 0h
Time Spent: 10m
> Remove Kafka Dependency Exclusion from ranger-plugins-audit in Impala FE
> pom.xml
> --------------------------------------------------------------------------------
>
> Key: IMPALA-13112
> URL: https://issues.apache.org/jira/browse/IMPALA-13112
> Project: IMPALA
> Issue Type: Improvement
> Components: fe
> Affects Versions: Impala 4.1.0, Impala 4.2.0, Impala 4.1.1, Impala 4.1.2,
> Impala 4.3.0, Impala 4.4.0
> Reporter: woosuk.ro
> Priority: Major
> Time Spent: 10m
> Remaining Estimate: 0h
>
> h4. Background:
> Previously, Impala removed the Kafka dependency from the
> {{ranger-plugins-audit}} module due to conflicts with the JAX-RS package.
> This conflict resulted in errors like {{{}java.lang.NoClassDefFoundError:
> javax/ws/rs/core/Link$Builder{}}}. Relevant commits include:
> # [Commit
> a1f4a849cf1c4f51e0acc737c7da166651645870|https://github.com/apache/impala/commit/a1f4a849cf1c4f51e0acc737c7da166651645870]
> # [Commit
> f85dbff97618066d60f37736808c8c24aa0a98e5|https://github.com/apache/impala/commit/f85dbff97618066d60f37736808c8c24aa0a98e5]
> These commits addressed the issue by excluding all Kafka dependencies to
> avoid JAX-RS version conflicts, specifically related to {{kafka_2.11}} and
> later {{{}kafka_2.12{}}}.
> h4. Current Situation:
> Recent tests indicate that the latest version of {{kafka-clients-2.8.1.jar}}
> used by Apache Ranger no longer causes the previous JAX-RS conflicts.
> Therefore, we propose to remove the exclusion of Kafka dependencies from
> {{ranger-plugins-audit}} in Impala's {{{}pom.xml{}}}. This change is
> necessary to utilize Ranger's {{{}kafkaAuditProvider{}}}, which requires
> Kafka clients.
> h4. Proposal:
> Modify the {{pom.xml}} file in Impala FE to remove the Kafka dependency
> exclusion from {{{}ranger-plugins-audit{}}}. This update will re-enable the
> Kafka-based audit logging capabilities in Ranger, which is essential for
> comprehensive audit logging.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
