[
https://issues.apache.org/jira/browse/HIVE-28140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17829475#comment-17829475
]
Stamatis Zampetakis commented on HIVE-28140:
--------------------------------------------
For future reference, I uploaded the output of the "mvn clean install
-DskipTests" command without the changes in PR#5135 in [^mvnout.txt] file. The
Kafka module is the second slowest to compile and this is mainly due to the
download attempts mentioned at the description of this ticket.
{noformat}
[INFO] Hive Kafka Storage Handler ......................... SUCCESS [01:18
min]{noformat}
> Remove unnecessary shading of test jars in Kafka module to speedup build
> ------------------------------------------------------------------------
>
> Key: HIVE-28140
> URL: https://issues.apache.org/jira/browse/HIVE-28140
> Project: Hive
> Issue Type: Task
> Components: kafka integration
> Reporter: Stamatis Zampetakis
> Assignee: Stamatis Zampetakis
> Priority: Major
> Labels: pull-request-available
> Attachments: mvnout.txt
>
>
> When the
> [shadeTestJar|https://github.com/apache/hive/blob/884981d1788c6966e895e2959ed954a22eb5c5eb/kafka-handler/pom.xml#L179]
> option is enabled it tries to fetch the test jars from all dependencies and
> include them in the shaded artifact.
> For every dependency, and every available repository, there is a download
> attempt that fails most of the time (since most dependencies do not publish
> the test artifacts).
> {noformat}
> Downloading from confluent:
> https://packages.confluent.io/maven/com/sun/jersey/contribs/jersey-guice/1.19.4/jersey-guice-1.19.4-tests.jar
> Downloading from central:
> https://repo.maven.apache.org/maven2/com/sun/jersey/contribs/jersey-guice/1.19.4/jersey-guice-1.19.4-tests.jar
> Downloading from repository-release:
> https://repository.apache.org/content/repositories/releases/com/sun/jersey/contribs/jersey-guice/1.19.4/jersey-guice-1.19.4-tests.jar
> Downloading from shibboleth:
> https://build.shibboleth.net/nexus/content/groups/public/com/sun/jersey/contribs/jersey-guice/1.19.4/jersey-guice-1.19.4-tests.jar
> [WARNING] Could not get tests for
> com.sun.jersey.contribs:jersey-guice:jar:1.19.4:compile
> {noformat}
> All these download attempts increase build time noticeably, especially on
> slow internet connections.
> Shading the test jars in Kafka module is not necessary since we are not using
> the resulting jars (kafka-handler-4.1.0-SNAPSHOT-tests.jar) anywhere inside
> the project (no occurrence of kafka-handler along with tests).
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
