[
https://issues.apache.org/jira/browse/HDDS-6626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17525994#comment-17525994
]
Attila Doroszlai edited comment on HDDS-6626 at 4/21/22 7:07 PM:
-----------------------------------------------------------------
BTW, the root cause is that HDDS-5431 added explicit dependency on
hadoop-shaded-protobuf for Ozone. This then leaks into the fat jar.
Reproducible with
[aa4f969188|https://github.com/apache/ozone/commit/aa4f969188], but not with
the prior commit.
{code}
[INFO] org.apache.ozone:ozone-filesystem-hadoop3:jar:1.2.0-SNAPSHOT
...
[INFO] +- org.apache.hadoop:hadoop-common:jar:3.3.1:provided
[INFO] | +-
org.apache.hadoop.thirdparty:hadoop-shaded-protobuf_3_7:jar:1.1.1:compile
[INFO] | +- org.apache.hadoop.thirdparty:hadoop-shaded-guava:jar:1.1.1:provided
{code}
was (Author: adoroszlai):
BTW, the root cause is that HDDS-5431 added explicit dependency on
hadoop-shaded-protobuf for Ozone. This then leaks into the fat jar.
Reproducible with
[aa4f969188|https://github.com/apache/ozone/commit/aa4f969188], but not with
the prior commit.
> Exclude Hadoop Thirdparty from shaded Ozone FS jars
> ---------------------------------------------------
>
> Key: HDDS-6626
> URL: https://issues.apache.org/jira/browse/HDDS-6626
> Project: Apache Ozone
> Issue Type: Bug
> Components: build, Ozone Filesystem
> Affects Versions: 1.2.0
> Reporter: Attila Doroszlai
> Assignee: Attila Doroszlai
> Priority: Major
> Labels: pull-request-available
>
> Shaded Ozone FS jars currently include Hadoop Thirdparty libs. This can
> result in version mismatch if the FS jars are used with different Hadoop
> version than the one we package with (3.3.1 currently). Hadoop Thirdparty
> libs should be excluded and provided by the user, similar to regular Hadoop
> libs (hadoop-common, hadoop-hdfs-client, etc.).
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
