[
https://issues.apache.org/jira/browse/HIVE-26220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17575353#comment-17575353
]
Chao Sun commented on HIVE-26220:
---------------------------------
I don't have a full list here but there were some previous attempt by
Liang-Chi: https://github.com/apache/hive/pull/2459
> I think most of the shaded dependencies can be relocated, I don't think that
> would be a problem, excluding couple of them like calcite.
Yes, it'd be great if we can shade most of the dependencies.
> Chao Sun have you tried using the current hive-exec from master?
[~kgyrtkirk] we haven't tried it yet, as Spark is still currently using Hive
2.3.9 and there's not strong motivation to move to a newer version of Hive. I
feel this doesn't have to be a blocker for the 4.0.0 release, since it'll be a
while for Spark to adopt the new version and we can solve the shading issue in
a next release.
> Shade & relocate dependencies in hive-exec to avoid conflicting with
> downstream projects
> ----------------------------------------------------------------------------------------
>
> Key: HIVE-26220
> URL: https://issues.apache.org/jira/browse/HIVE-26220
> Project: Hive
> Issue Type: Improvement
> Affects Versions: 4.0.0, 4.0.0-alpha-1
> Reporter: Chao Sun
> Priority: Blocker
>
> Currently projects like Spark, Trino/Presto, Iceberg, etc, are depending on
> {{hive-exec:core}} which was removed in HIVE-25531. The reason these projects
> use {{hive-exec:core}} is because they have the flexibility to exclude, shade
> & relocate dependencies in {{hive-exec}} that conflict with the ones they
> brought in by themselves. However, with {{hive-exec}} this is no longer
> possible, since it is a fat jar that shade those dependencies but do not
> relocate many of them.
> In order for the downstream projects to consume {{hive-exec}}, we will need
> to make sure all the dependencies in {{hive-exec}} are properly shaded and
> relocated, so they won't cause conflicts with those from the downstream.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
