[
https://issues.apache.org/jira/browse/IMPALA-12221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17810262#comment-17810262
]
Quanlong Huang commented on IMPALA-12221:
-----------------------------------------
I think the issue comes from hive-site.xml.
In my dev env, when launching impalad, the logs show that hive-site.xml under
${IMPALA_HOME}/fe/src/test/resources/ is used.
{noformat}
I0122 12:44:46.118683 17717 HiveConf.java:293] Found configuration file
file:/home/quanlong/workspace/Impala/fe/src/test/resources/hive-site.xml
I0122 12:44:46.602887 17717 MetastoreConf.java:2035] Found configuration file
file:/home/quanlong/workspace/Impala/fe/src/test/resources/hive-site.xml
I0122 12:44:46.603626 17717 MetastoreConf.java:2028] Unable to find config file
hivemetastore-site.xml
I0122 12:44:46.603684 17717 MetastoreConf.java:2035] Found configuration file
null
I0122 12:44:46.604097 17717 MetastoreConf.java:2028] Unable to find config file
metastore-site.xml
I0122 12:44:46.604152 17717 MetastoreConf.java:2035] Found configuration file
null{noformat}
In your logs, it shows hive-site.xml in the toolchain is used:
/bianqi/impala-4.3.0/toolchain/cdp_components-40643771/apache-hive-3.1.3000.7.2.18.0-41-bin/conf/hive-site.xml
It might be the default configuration file that is missing some correct
configuration, e.g.
{code:xml}
<property>
<name>javax.jdo.option.ConnectionDriverName</name>
<value>org.postgresql.Driver</value>
</property>
<property>
<name>javax.jdo.option.ConnectionPassword</name>
<value>password</value>
</property>
<property>
<name>javax.jdo.option.ConnectionURL</name>
<value>jdbc:postgresql://localhost:5432/HMS_home_quanlong_workspace_Impala_cdp</value>
</property>
<property>
<name>javax.jdo.option.ConnectionUserName</name>
<value>hiveuser</value>
</property>{code}
Did you customize hive-site.xml? If you want to use what the dev env
configures, you can run bin/create-test-configuration.sh to generate the xml
files under ${IMPALA_HOME}/fe/src/test/resources/
> Start Impalad java.lang.NoClassDefFoundError: javax/jdo/JDOException
> --------------------------------------------------------------------
>
> Key: IMPALA-12221
> URL: https://issues.apache.org/jira/browse/IMPALA-12221
> Project: IMPALA
> Issue Type: Bug
> Components: Clients
> Affects Versions: Impala 4.3.0
> Reporter: bianqi
> Priority: Blocker
> Fix For: Not Applicable
>
>
> When I execute/ Start-impala-cluster.py - s 1-- restart_ Impalad_ Only, the
> imported service did not start successfully; Observing the logs, it was found
> that there was a class conflict;
> {code:java}
> I0616 11:50:26.499475 32367 MetastoreConf.java:2025] Found configuration file
> file:/bianqi/impala-4.3.0/toolchain/cdp_components-40643771/apache-hive-3.1.3000.7.2.18.0-41-bin/conf/hive-site.xml
> I0616 11:50:26.499955 32367 MetastoreConf.java:2018] Unable to find config
> file hivemetastore-site.xml
> I0616 11:50:26.500003 32367 MetastoreConf.java:2025] Found configuration file
> null
> I0616 11:50:26.500358 32367 MetastoreConf.java:2018] Unable to find config
> file metastore-site.xml
> I0616 11:50:26.500401 32367 MetastoreConf.java:2025] Found configuration file
> null
> I0616 11:50:26.571043 32367 QueryEventHookManager.java:94] QueryEventHook
> config:
> I0616 11:50:26.571125 32367 QueryEventHookManager.java:95] -
> query_event_hook_nthreads=1
> I0616 11:50:26.571159 32367 QueryEventHookManager.java:96] -
> query_event_hook_classes=
> I0616 11:50:26.634904 32367 HiveMetaStoreClient.java:272] HMS client
> filtering is enabled.
> W0616 11:50:26.698336 32367 MetaStoreClientPool.java:107] Failed to connect
> to Hive MetaStore. Retrying.
> Java exception follows:
> java.lang.RuntimeException: Unable to instantiate
> org.apache.hadoop.hive.metastore.HiveMetaStoreClient
> at
> org.apache.hadoop.hive.metastore.utils.JavaUtils.newInstance(JavaUtils.java:86)
> at
> org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.<init>(RetryingMetaStoreClient.java:98)
> at
> org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(RetryingMetaStoreClient.java:151)
> at
> org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(RetryingMetaStoreClient.java:122)
> at
> org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(RetryingMetaStoreClient.java:115)
> at
> org.apache.impala.catalog.MetaStoreClientPool$MetaStoreClient.<init>(MetaStoreClientPool.java:99)
> at
> org.apache.impala.catalog.MetaStoreClientPool$MetaStoreClient.<init>(MetaStoreClientPool.java:78)
> at
> org.apache.impala.catalog.MetaStoreClientPool.initClients(MetaStoreClientPool.java:174)
> at
> org.apache.impala.catalog.MetaStoreClientPool.<init>(MetaStoreClientPool.java:163)
> at
> org.apache.impala.catalog.MetaStoreClientPool.<init>(MetaStoreClientPool.java:155)
> at org.apache.impala.service.Frontend.<init>(Frontend.java:506)
> at org.apache.impala.service.Frontend.<init>(Frontend.java:460)
> at org.apache.impala.service.JniFrontend.<init>(JniFrontend.java:146)
> Caused by: java.lang.reflect.InvocationTargetException
> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
> Method)
> at
> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
> at
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
> at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
> at
> org.apache.hadoop.hive.metastore.utils.JavaUtils.newInstance(JavaUtils.java:84)
> ... 12 more
> Caused by: java.lang.NoClassDefFoundError: javax/jdo/JDOException
> at
> org.apache.hadoop.hive.metastore.HiveMetaStore.newRetryingHMSHandler(HiveMetaStore.java:11281)
> at
> org.apache.hadoop.hive.metastore.HiveMetaStoreClient.<init>(HiveMetaStoreClient.java:212)
> ... 17 more
> Caused by: java.lang.ClassNotFoundException: javax.jdo.JDOException
> at java.net.URLClassLoader.findClass(URLClassLoader.java:387)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:418)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:351) {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscr...@impala.apache.org
For additional commands, e-mail: issues-all-h...@impala.apache.org
