Quanlong Huang has posted comments on this change. (
http://gerrit.cloudera.org:8080/21760 )
Change subject: IMPALA-12349: Support Apache Hive 2.x in Impala
......................................................................
Patch Set 111:
(1 comment)
> Patch Set 111:
>
> (5 comments)
>
> I tried building the patch on Ubuntu 22.04 using -noclean -notests -format
> options.
>
> The build succeeded but initializing the cluster failed:
>
> ERROR in /root/impala/bin/create-test-configuration.sh at line 204:
> CLASSPATH={$CLASSPATH}:${CONFIG_DIR} ${HIVE_HOME}/bin/schematool -initSchema
> -dbType \
> Generated:
> /root/impala/logs/extra_junit_xml_logs/generate_junitxml.buildall.create-test-configuration.20251118_03_23_26.xml
>
> Checked logs/cluster/schematool.log,
>
> Metastore connection URL:
> jdbc:postgresql://localhost:5432/HMS_root_impala_apache
> Metastore Connection Driver : org.postgresql.Driver
> Metastore connection User: hiveuser
> org.apache.hadoop.hive.metastore.HiveMetaException: Failed to get schema
> version.
> Underlying cause: org.postgresql.util.PSQLException : The authentication type
> 10 is not supported. Check that you have configured the pg_hba.conf file to
> include the client's IP address or subnet, and that it is using an
> authentication scheme supported by the driver.
> SQL Error code: 0
> Use --verbose for detailed stacktrace.
> *** schemaTool failed ***
>
> It seems we need to upgrade the PostgreSQL JDBC Driver used by Apache Hive 2.
I can work around the issue by removing the old pg driver and put a new one in
$HIVE_HOME/
rm
toolchain/apache_components/apache-hive-2.3.9-bin/lib/postgresql-9.4.1208.jre7.jar
mkdir toolchain/apache_components/apache-hive-2.3.9-bin/auxlib
cp fe/target/dependency/postgresql-42.5.6.jar
toolchain/apache_components/apache-hive-2.3.9-bin/auxlib
Then the cluster can be set up correctly. However, when launching impala,
impalad and catalogd failed by
I20251117 19:56:52.377930 52764 jni-util.cc:321]
java.lang.NoClassDefFoundError: org/apache/hadoop/hive/metastore/api/Database
at
org.apache.impala.catalog.BuiltinsDb.createMetastoreDb(BuiltinsDb.java:126)
at org.apache.impala.catalog.BuiltinsDb.<init>(BuiltinsDb.java:94)
at org.apache.impala.catalog.BuiltinsDb.getInstance(BuiltinsDb.java:81)
at org.apache.impala.analysis.SqlScanner.init(SqlScanner.java:772)
at org.apache.impala.analysis.SqlScanner.<clinit>(SqlScanner.java:789)
at org.apache.impala.service.BackendConfig.create(BackendConfig.java:60)
at org.apache.impala.service.BackendConfig.create(BackendConfig.java:53)
at org.apache.impala.service.JniCatalog.<init>(JniCatalog.java:142)
Caused by: java.lang.ClassNotFoundException:
org.apache.hadoop.hive.metastore.api.Database
at java.net.URLClassLoader.findClass(URLClassLoader.java:387)
at java.lang.ClassLoader.loadClass(ClassLoader.java:418)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352)
at java.lang.ClassLoader.loadClass(ClassLoader.java:351)
... 8 more
http://gerrit.cloudera.org:8080/#/c/21760/111/bin/create-test-configuration.sh
File bin/create-test-configuration.sh:
http://gerrit.cloudera.org:8080/#/c/21760/111/bin/create-test-configuration.sh@204
PS111, Line 204: {$CLASSPATH}
I think this is a typo. It should be ${CLASSPATH}. But it seems the CLASSPATH
variable is not used by schematool at all. The script creates its own CLASSPATH
variable.
--
To view, visit http://gerrit.cloudera.org:8080/21760
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings
Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: Ib5f104dc8d131835b8118b9d54077471db65681c
Gerrit-Change-Number: 21760
Gerrit-PatchSet: 111
Gerrit-Owner: ttttttz <[email protected]>
Gerrit-Reviewer: Impala Public Jenkins <[email protected]>
Gerrit-Reviewer: Pranav Lodha <[email protected]>
Gerrit-Reviewer: Quanlong Huang <[email protected]>
Gerrit-Reviewer: Zihao Ye <[email protected]>
Gerrit-Reviewer: ttttttz <[email protected]>
Gerrit-Comment-Date: Tue, 18 Nov 2025 03:58:31 +0000
Gerrit-HasComments: Yes
