[ 
https://issues.apache.org/jira/browse/HDDS-6626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17525964#comment-17525964
 ] 

Attila Doroszlai commented on HDDS-6626:
----------------------------------------

[~kerneltime],

These thirdparty jars (hadoop-shaded-guava, hadoop-shaded-protobuf) are 
distributed by Hadoop.  We do not include a specific version of Hadoop jars in 
Ozone FS jar to allow using any compatible Hadoop version.  The application 
provides Hadoop jars and only needs to add Ozone FS jar to the classpath.  A 
newer Hadoop version may bump its version of thirdparty libs.  By including a 
specific version of these (specifically hadoop-shaded-protobuf) in the Ozone FS 
jar, the application using newer Hadoop may run into classloading problems.

> Exclude Hadoop Thirdparty from shaded Ozone FS jars
> ---------------------------------------------------
>
>                 Key: HDDS-6626
>                 URL: https://issues.apache.org/jira/browse/HDDS-6626
>             Project: Apache Ozone
>          Issue Type: Bug
>          Components: build, Ozone Filesystem
>            Reporter: Attila Doroszlai
>            Assignee: Attila Doroszlai
>            Priority: Major
>              Labels: pull-request-available
>
> Shaded Ozone FS jars currently include Hadoop Thirdparty libs.  This can 
> result in version mismatch if the FS jars are used with different Hadoop 
> version than the one we package with (3.3.1 currently).  Hadoop Thirdparty 
> libs should be excluded and provided by the user, similar to regular Hadoop 
> libs (hadoop-common, hadoop-hdfs-client, etc.).



--
This message was sent by Atlassian Jira
(v8.20.7#820007)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to