[ 
https://issues.apache.org/jira/browse/HUDI-5731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alexey Kudinkin updated HUDI-5731:
----------------------------------
    Description: 
As originally reported in:

[https://github.com/apache/hudi/pull/6240#issuecomment-1420149952]

 

The issue have been that after removal of Guava we still kept following 
relocations configs in MR/Spark bundles:
{code:java}
<relocation>
  <pattern>com.google.common.</pattern>
  <shadedPattern>org.apache.hudi.com.google.common.</shadedPattern>
</relocation> {code}
Which in turn meant that all references from any class referencing Guava would 
be shaded, even though Hudi isn't packaging Guava anymore. This might result in 
following exception:
{code:java}
Caused by: java.lang.NoClassDefFoundError: 
org/apache/hudi/com/google/common/base/Preconditions
        at 
org.apache.curator.ensemble.fixed.FixedEnsembleProvider.<init>(FixedEnsembleProvider.java:39)
        at 
org.apache.curator.framework.CuratorFrameworkFactory$Builder.connectString(CuratorFrameworkFactory.java:193)
        at 
org.apache.kyuubi.ha.client.zookeeper.ZookeeperClientProvider$.buildZookeeperClient(ZookeeperClientProvider.scala:62)
        at 
org.apache.kyuubi.ha.client.zookeeper.ZookeeperDiscoveryClient.<init>(ZookeeperDiscoveryClient.scala:65)
        ... 45 more {code}

  was:Configure guava relocation in Spark and MR bundle pom.xml, but there is 
no guava dependency, resulting in failure of guava-related class loading.


> Fix com.google.common classes still being relocated in Hudi Spark bundle
> ------------------------------------------------------------------------
>
>                 Key: HUDI-5731
>                 URL: https://issues.apache.org/jira/browse/HUDI-5731
>             Project: Apache Hudi
>          Issue Type: Bug
>    Affects Versions: 0.12.1
>            Reporter: dzcxzl
>            Assignee: Alexey Kudinkin
>            Priority: Critical
>              Labels: pull-request-available
>
> As originally reported in:
> [https://github.com/apache/hudi/pull/6240#issuecomment-1420149952]
>  
> The issue have been that after removal of Guava we still kept following 
> relocations configs in MR/Spark bundles:
> {code:java}
> <relocation>
>   <pattern>com.google.common.</pattern>
>   <shadedPattern>org.apache.hudi.com.google.common.</shadedPattern>
> </relocation> {code}
> Which in turn meant that all references from any class referencing Guava 
> would be shaded, even though Hudi isn't packaging Guava anymore. This might 
> result in following exception:
> {code:java}
> Caused by: java.lang.NoClassDefFoundError: 
> org/apache/hudi/com/google/common/base/Preconditions
>       at 
> org.apache.curator.ensemble.fixed.FixedEnsembleProvider.<init>(FixedEnsembleProvider.java:39)
>       at 
> org.apache.curator.framework.CuratorFrameworkFactory$Builder.connectString(CuratorFrameworkFactory.java:193)
>       at 
> org.apache.kyuubi.ha.client.zookeeper.ZookeeperClientProvider$.buildZookeeperClient(ZookeeperClientProvider.scala:62)
>       at 
> org.apache.kyuubi.ha.client.zookeeper.ZookeeperDiscoveryClient.<init>(ZookeeperDiscoveryClient.scala:65)
>       ... 45 more {code}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to