[
https://issues.apache.org/jira/browse/HBASE-28434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17904262#comment-17904262
]
Istvan Toth commented on HBASE-28434:
-------------------------------------
This is the difference between the original and the hadoop-less assembly lib
dir:
(With the patch applied on top of the refactor and jax-ws patches)
{noformat}
diff -r . ../../../../hbase-assembly/target/hbase-4.0.0-alpha-1-SNAPSHOT/lib/
Only in ../../../../hbase-assembly/target/hbase-4.0.0-alpha-1-SNAPSHOT/lib/:
animal-sniffer-annotations-1.17.jar
Only in ../../../../hbase-assembly/target/hbase-4.0.0-alpha-1-SNAPSHOT/lib/:
aopalliance-1.0.jar
Only in ../../../../hbase-assembly/target/hbase-4.0.0-alpha-1-SNAPSHOT/lib/:
avro-1.11.4.jar
Only in ../../../../hbase-assembly/target/hbase-4.0.0-alpha-1-SNAPSHOT/lib/:
commons-compress-1.26.1.jar
Only in ../../../../hbase-assembly/target/hbase-4.0.0-alpha-1-SNAPSHOT/lib/:
commons-configuration2-2.10.1.jar
Only in ../../../../hbase-assembly/target/hbase-4.0.0-alpha-1-SNAPSHOT/lib/:
commons-daemon-1.0.13.jar
Only in ../../../../hbase-assembly/target/hbase-4.0.0-alpha-1-SNAPSHOT/lib/:
commons-net-3.9.0.jar
Only in ../../../../hbase-assembly/target/hbase-4.0.0-alpha-1-SNAPSHOT/lib/:
commons-text-1.10.0.jar
Only in ../../../../hbase-assembly/target/hbase-4.0.0-alpha-1-SNAPSHOT/lib/:
curator-client-4.2.0.jar
Only in ../../../../hbase-assembly/target/hbase-4.0.0-alpha-1-SNAPSHOT/lib/:
curator-framework-4.2.0.jar
Only in ../../../../hbase-assembly/target/hbase-4.0.0-alpha-1-SNAPSHOT/lib/:
curator-recipes-4.2.0.jar
Only in ../../../../hbase-assembly/target/hbase-4.0.0-alpha-1-SNAPSHOT/lib/:
dnsjava-3.6.1.jar
Only in ../../../../hbase-assembly/target/hbase-4.0.0-alpha-1-SNAPSHOT/lib/:
failureaccess-1.0.jar
Only in ../../../../hbase-assembly/target/hbase-4.0.0-alpha-1-SNAPSHOT/lib/:
gson-2.9.0.jar
Only in ../../../../hbase-assembly/target/hbase-4.0.0-alpha-1-SNAPSHOT/lib/:
guava-27.0-jre.jar
Only in ../../../../hbase-assembly/target/hbase-4.0.0-alpha-1-SNAPSHOT/lib/:
guice-4.2.3.jar
Only in ../../../../hbase-assembly/target/hbase-4.0.0-alpha-1-SNAPSHOT/lib/:
guice-servlet-4.2.3.jar
Only in ../../../../hbase-assembly/target/hbase-4.0.0-alpha-1-SNAPSHOT/lib/:
hadoop-annotations-3.4.1.jar
Only in ../../../../hbase-assembly/target/hbase-4.0.0-alpha-1-SNAPSHOT/lib/:
hadoop-auth-3.4.1.jar
Only in ../../../../hbase-assembly/target/hbase-4.0.0-alpha-1-SNAPSHOT/lib/:
hadoop-common-3.4.1.jar
Only in ../../../../hbase-assembly/target/hbase-4.0.0-alpha-1-SNAPSHOT/lib/:
hadoop-distcp-3.4.1.jar
Only in ../../../../hbase-assembly/target/hbase-4.0.0-alpha-1-SNAPSHOT/lib/:
hadoop-hdfs-3.4.1.jar
Only in ../../../../hbase-assembly/target/hbase-4.0.0-alpha-1-SNAPSHOT/lib/:
hadoop-hdfs-client-3.4.1.jar
Only in ../../../../hbase-assembly/target/hbase-4.0.0-alpha-1-SNAPSHOT/lib/:
hadoop-mapreduce-client-core-3.4.1.jar
Only in ../../../../hbase-assembly/target/hbase-4.0.0-alpha-1-SNAPSHOT/lib/:
hadoop-shaded-guava-1.3.0.jar
Only in ../../../../hbase-assembly/target/hbase-4.0.0-alpha-1-SNAPSHOT/lib/:
hadoop-shaded-protobuf_3_25-1.3.0.jar
Only in ../../../../hbase-assembly/target/hbase-4.0.0-alpha-1-SNAPSHOT/lib/:
hadoop-yarn-api-3.4.1.jar
Only in ../../../../hbase-assembly/target/hbase-4.0.0-alpha-1-SNAPSHOT/lib/:
hadoop-yarn-client-3.4.1.jar
Only in ../../../../hbase-assembly/target/hbase-4.0.0-alpha-1-SNAPSHOT/lib/:
hadoop-yarn-common-3.4.1.jar
Only in ../../../../hbase-assembly/target/hbase-4.0.0-alpha-1-SNAPSHOT/lib/:
j2objc-annotations-1.1.jar
Only in ../../../../hbase-assembly/target/hbase-4.0.0-alpha-1-SNAPSHOT/lib/:
jackson-jaxrs-base-2.12.7.jar
Only in ../../../../hbase-assembly/target/hbase-4.0.0-alpha-1-SNAPSHOT/lib/:
jackson-jaxrs-json-provider-2.12.7.jar
Only in ../../../../hbase-assembly/target/hbase-4.0.0-alpha-1-SNAPSHOT/lib/:
jaxb-impl-2.2.3-1.jar
Only in ../../../../hbase-assembly/target/hbase-4.0.0-alpha-1-SNAPSHOT/lib/:
jcip-annotations-1.0-1.jar
Only in ../../../../hbase-assembly/target/hbase-4.0.0-alpha-1-SNAPSHOT/lib/:
jersey-json-1.22.0.jar
Only in ../../../../hbase-assembly/target/hbase-4.0.0-alpha-1-SNAPSHOT/lib/:
jetty-client-9.4.53.v20231009.jar
Only in ../../../../hbase-assembly/target/hbase-4.0.0-alpha-1-SNAPSHOT/lib/:
jetty-http-9.4.53.v20231009.jar
Only in ../../../../hbase-assembly/target/hbase-4.0.0-alpha-1-SNAPSHOT/lib/:
jetty-io-9.4.53.v20231009.jar
Only in ../../../../hbase-assembly/target/hbase-4.0.0-alpha-1-SNAPSHOT/lib/:
jetty-security-9.4.53.v20231009.jar
Only in ../../../../hbase-assembly/target/hbase-4.0.0-alpha-1-SNAPSHOT/lib/:
jetty-server-9.4.53.v20231009.jar
Only in ../../../../hbase-assembly/target/hbase-4.0.0-alpha-1-SNAPSHOT/lib/:
jetty-servlet-9.4.53.v20231009.jar
Only in ../../../../hbase-assembly/target/hbase-4.0.0-alpha-1-SNAPSHOT/lib/:
jetty-util-9.4.53.v20231009.jar
Only in ../../../../hbase-assembly/target/hbase-4.0.0-alpha-1-SNAPSHOT/lib/:
jetty-util-ajax-9.4.53.v20231009.jar
Only in ../../../../hbase-assembly/target/hbase-4.0.0-alpha-1-SNAPSHOT/lib/:
jetty-webapp-9.4.53.v20231009.jar
Only in ../../../../hbase-assembly/target/hbase-4.0.0-alpha-1-SNAPSHOT/lib/:
jetty-xml-9.4.53.v20231009.jar
Only in ../../../../hbase-assembly/target/hbase-4.0.0-alpha-1-SNAPSHOT/lib/:
jline-3.9.0.jar
Only in ../../../../hbase-assembly/target/hbase-4.0.0-alpha-1-SNAPSHOT/lib/:
jsch-0.1.55.jar
Only in ../../../../hbase-assembly/target/hbase-4.0.0-alpha-1-SNAPSHOT/lib/:
kerb-core-1.0.1.jar
Only in ../../../../hbase-assembly/target/hbase-4.0.0-alpha-1-SNAPSHOT/lib/:
kerb-crypto-2.0.3.jar
Only in ../../../../hbase-assembly/target/hbase-4.0.0-alpha-1-SNAPSHOT/lib/:
kerb-util-2.0.3.jar
Only in ../../../../hbase-assembly/target/hbase-4.0.0-alpha-1-SNAPSHOT/lib/:
kerby-asn1-1.0.1.jar
Only in ../../../../hbase-assembly/target/hbase-4.0.0-alpha-1-SNAPSHOT/lib/:
kerby-config-2.0.3.jar
Only in ../../../../hbase-assembly/target/hbase-4.0.0-alpha-1-SNAPSHOT/lib/:
kerby-pkix-1.0.1.jar
Only in ../../../../hbase-assembly/target/hbase-4.0.0-alpha-1-SNAPSHOT/lib/:
kerby-util-1.0.1.jar
Only in ../../../../hbase-assembly/target/hbase-4.0.0-alpha-1-SNAPSHOT/lib/:
listenablefuture-9999.0-empty-to-avoid-conflict-with-guava.jar
Only in ../../../../hbase-assembly/target/hbase-4.0.0-alpha-1-SNAPSHOT/lib/:
netty-all-4.1.112.Final.jar
Only in ../../../../hbase-assembly/target/hbase-4.0.0-alpha-1-SNAPSHOT/lib/:
netty-buffer-4.1.112.Final.jar
Only in ../../../../hbase-assembly/target/hbase-4.0.0-alpha-1-SNAPSHOT/lib/:
netty-codec-4.1.112.Final.jar
Only in ../../../../hbase-assembly/target/hbase-4.0.0-alpha-1-SNAPSHOT/lib/:
netty-codec-dns-4.1.112.Final.jar
Only in ../../../../hbase-assembly/target/hbase-4.0.0-alpha-1-SNAPSHOT/lib/:
netty-codec-haproxy-4.1.112.Final.jar
Only in ../../../../hbase-assembly/target/hbase-4.0.0-alpha-1-SNAPSHOT/lib/:
netty-codec-http2-4.1.112.Final.jar
Only in ../../../../hbase-assembly/target/hbase-4.0.0-alpha-1-SNAPSHOT/lib/:
netty-codec-http-4.1.112.Final.jar
Only in ../../../../hbase-assembly/target/hbase-4.0.0-alpha-1-SNAPSHOT/lib/:
netty-codec-memcache-4.1.112.Final.jar
Only in ../../../../hbase-assembly/target/hbase-4.0.0-alpha-1-SNAPSHOT/lib/:
netty-codec-mqtt-4.1.112.Final.jar
Only in ../../../../hbase-assembly/target/hbase-4.0.0-alpha-1-SNAPSHOT/lib/:
netty-codec-redis-4.1.112.Final.jar
Only in ../../../../hbase-assembly/target/hbase-4.0.0-alpha-1-SNAPSHOT/lib/:
netty-codec-smtp-4.1.112.Final.jar
Only in ../../../../hbase-assembly/target/hbase-4.0.0-alpha-1-SNAPSHOT/lib/:
netty-codec-socks-4.1.112.Final.jar
Only in ../../../../hbase-assembly/target/hbase-4.0.0-alpha-1-SNAPSHOT/lib/:
netty-codec-stomp-4.1.112.Final.jar
Only in ../../../../hbase-assembly/target/hbase-4.0.0-alpha-1-SNAPSHOT/lib/:
netty-codec-xml-4.1.112.Final.jar
Only in ../../../../hbase-assembly/target/hbase-4.0.0-alpha-1-SNAPSHOT/lib/:
netty-common-4.1.112.Final.jar
Only in ../../../../hbase-assembly/target/hbase-4.0.0-alpha-1-SNAPSHOT/lib/:
netty-handler-4.1.112.Final.jar
Only in ../../../../hbase-assembly/target/hbase-4.0.0-alpha-1-SNAPSHOT/lib/:
netty-handler-proxy-4.1.112.Final.jar
Only in ../../../../hbase-assembly/target/hbase-4.0.0-alpha-1-SNAPSHOT/lib/:
netty-handler-ssl-ocsp-4.1.112.Final.jar
Only in ../../../../hbase-assembly/target/hbase-4.0.0-alpha-1-SNAPSHOT/lib/:
netty-resolver-4.1.112.Final.jar
Only in ../../../../hbase-assembly/target/hbase-4.0.0-alpha-1-SNAPSHOT/lib/:
netty-resolver-dns-4.1.112.Final.jar
Only in ../../../../hbase-assembly/target/hbase-4.0.0-alpha-1-SNAPSHOT/lib/:
netty-resolver-dns-classes-macos-4.1.112.Final.jar
Only in ../../../../hbase-assembly/target/hbase-4.0.0-alpha-1-SNAPSHOT/lib/:
netty-resolver-dns-native-macos-4.1.112.Final-osx-aarch_64.jar
Only in ../../../../hbase-assembly/target/hbase-4.0.0-alpha-1-SNAPSHOT/lib/:
netty-resolver-dns-native-macos-4.1.112.Final-osx-x86_64.jar
Only in ../../../../hbase-assembly/target/hbase-4.0.0-alpha-1-SNAPSHOT/lib/:
netty-transport-4.1.112.Final.jar
Only in ../../../../hbase-assembly/target/hbase-4.0.0-alpha-1-SNAPSHOT/lib/:
netty-transport-classes-epoll-4.1.112.Final.jar
Only in ../../../../hbase-assembly/target/hbase-4.0.0-alpha-1-SNAPSHOT/lib/:
netty-transport-classes-kqueue-4.1.112.Final.jar
Only in ../../../../hbase-assembly/target/hbase-4.0.0-alpha-1-SNAPSHOT/lib/:
netty-transport-native-epoll-4.1.112.Final.jar
Only in ../../../../hbase-assembly/target/hbase-4.0.0-alpha-1-SNAPSHOT/lib/:
netty-transport-native-epoll-4.1.112.Final-linux-aarch_64.jar
Only in ../../../../hbase-assembly/target/hbase-4.0.0-alpha-1-SNAPSHOT/lib/:
netty-transport-native-epoll-4.1.112.Final-linux-riscv64.jar
Only in ../../../../hbase-assembly/target/hbase-4.0.0-alpha-1-SNAPSHOT/lib/:
netty-transport-native-epoll-4.1.112.Final-linux-x86_64.jar
Only in ../../../../hbase-assembly/target/hbase-4.0.0-alpha-1-SNAPSHOT/lib/:
netty-transport-native-kqueue-4.1.112.Final-osx-aarch_64.jar
Only in ../../../../hbase-assembly/target/hbase-4.0.0-alpha-1-SNAPSHOT/lib/:
netty-transport-native-kqueue-4.1.112.Final-osx-x86_64.jar
Only in ../../../../hbase-assembly/target/hbase-4.0.0-alpha-1-SNAPSHOT/lib/:
netty-transport-native-unix-common-4.1.112.Final.jar
Only in ../../../../hbase-assembly/target/hbase-4.0.0-alpha-1-SNAPSHOT/lib/:
netty-transport-rxtx-4.1.112.Final.jar
Only in ../../../../hbase-assembly/target/hbase-4.0.0-alpha-1-SNAPSHOT/lib/:
netty-transport-sctp-4.1.112.Final.jar
Only in ../../../../hbase-assembly/target/hbase-4.0.0-alpha-1-SNAPSHOT/lib/:
netty-transport-udt-4.1.112.Final.jar
Only in ../../../../hbase-assembly/target/hbase-4.0.0-alpha-1-SNAPSHOT/lib/:
nimbus-jose-jwt-9.37.2.jar
Only in ../../../../hbase-assembly/target/hbase-4.0.0-alpha-1-SNAPSHOT/lib/:
re2j-1.1.jar
Only in
../../../../hbase-assembly/target/hbase-4.0.0-alpha-1-SNAPSHOT/lib/shaded-clients:
hbase-shaded-client-4.0.0-alpha-1-SNAPSHOT.jar
Only in ../../../../hbase-assembly/target/hbase-4.0.0-alpha-1-SNAPSHOT/lib/:
stax2-api-4.2.1.jar
Only in ../../../../hbase-assembly/target/hbase-4.0.0-alpha-1-SNAPSHOT/lib/:
websocket-api-9.4.53.v20231009.jar
Only in ../../../../hbase-assembly/target/hbase-4.0.0-alpha-1-SNAPSHOT/lib/:
websocket-client-9.4.53.v20231009.jar
Only in ../../../../hbase-assembly/target/hbase-4.0.0-alpha-1-SNAPSHOT/lib/:
websocket-common-9.4.53.v20231009.jar
Only in ../../../../hbase-assembly/target/hbase-4.0.0-alpha-1-SNAPSHOT/lib/:
woodstox-core-5.4.0.jar
{noformat}
> Update assembly to create a tarball with hadoop and without hadoop
> ------------------------------------------------------------------
>
> Key: HBASE-28434
> URL: https://issues.apache.org/jira/browse/HBASE-28434
> Project: HBase
> Issue Type: Sub-task
> Reporter: Nihal Jain
> Assignee: Istvan Toth
> Priority: Major
> Labels: pull-request-available
>
> The goal of this task is to update the HBase assembly by providing two
> distinct variants - one that includes Hadoop and one that does not.
> Currently, our assembly includes a substantial amount of the Hadoop
> distribution. This task involves modifying our build and assembly process to
> create two separate distributions of HBase:
> * A variant that includes Hadoop, serving as a complete package for users who
> do not have a pre-existing Hadoop installation.
> * A leaner variant without Hadoop, suitable for environments where Hadoop is
> already installed and configured.
> This change aims to reduce the distribution size, speed up startup times, and
> decrease the chance of conflicts with the Hadoop jars. It also aims to reduce
> the number of CVE-prone JARs in the binary assemblies.
> The task includes ensuring that both variants function correctly in their
> respective scenarios and that existing functionality is not negatively
> impacted.
> CC: [~stoty], [~zhangduo], [~ndimiduk], [~bbeaudreault]
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
