caijialiang created BIGTOP-3966:
-----------------------------------

             Summary: Make hive  3.1.3  compatible with hadoop 3.3.5
                 Key: BIGTOP-3966
                 URL: https://issues.apache.org/jira/browse/BIGTOP-3966
             Project: Bigtop
          Issue Type: Bug
            Reporter: caijialiang
         Attachments: image-2023-07-27-14-45-11-157.png, 
image-2023-07-27-14-45-33-894.png, image-2023-07-27-14-46-41-989.png

Hive version: 3.1.3
Hadoop version: 3.3.5

After upgrading to Hadoop 3.3.5, the Hive WebHCat server fails to start because 
of inconsistent versions of the Jersey JAR package. Hive HCat lacks the 
jersey-server-1.19 jar.

!image-2023-07-27-14-46-41-989.png!


The issue is as follows: The startup script of the Hive WebHCat server sets the 
Hadoop class path. It first loads from its own class path, and if not found, it 
looks for it in the Hadoop class path. 
/usr/lib/hive-hcatalog/sbin/webhcat_server.sh
!image-2023-07-27-14-45-11-157.png!

 

In Hadoop 3.3.4, the version of the Jersey-related JARs in Hadoop is 1.19, 
which matches that of Hive. Therefore, even though the Hive WebHCat server does 
not contain jersey-server-1.19.jar, it successfully loads 
jersey-server-{color:#FF0000}1.19{color}.jar from the Hadoop class path, and no 
error occurs.
!image-2023-07-27-14-45-33-894.png!

However, after upgrading to Hadoop 3.3.5, Hadoop updates jersey to version 
{color:#FF0000}1.19.4{color}, which is inconsistent with the jersey version in 
the Hive WebHCat server. As a result, the startup fails. To resolve this, 
manually download a package and place it in 
/usr/lib/hive-hcatalog/share/webhcat/svr/lib/

Therefore, when packaging the Hive , it should specify the  jersey version 
consistent with hadoop's   to avoid version conflicts.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to