Joe McDonnell created IMPALA-11109:
--------------------------------------
Summary: Exhaustive tests fail in
custom_cluster.test_permanent_udfs.py
Key: IMPALA-11109
URL: https://issues.apache.org/jira/browse/IMPALA-11109
Project: IMPALA
Issue Type: Bug
Components: Catalog, Frontend
Affects Versions: Impala 4.1.0
Reporter: Joe McDonnell
Assignee: Steve Carlin
Exhaustive test runs are failing when running
custom_cluster/test_permanent_udfs.py, specifically
TestUdfPersistence.test_corrupt_java_udf. Subsequent unrelated custom cluster
tests fail with problems related to catalogd startup.
It looks like catalog startup is failing with ClassNotFoundException:
{noformat}
I0204 14:31:36.283778 18607 jni-util.cc:286] java.lang.NoClassDefFoundError:
com/google/i18n/phonenumbers/NumberParseException
at java.lang.Class.getDeclaredMethods0(Native Method)
at java.lang.Class.privateGetDeclaredMethods(Class.java:2701)
at java.lang.Class.privateGetPublicMethods(Class.java:2902)
at java.lang.Class.getMethods(Class.java:1615)
at
org.apache.impala.hive.executor.HiveLegacyJavaFunction.extract(HiveLegacyJavaFunction.java:150)
at
org.apache.impala.catalog.CatalogServiceCatalog.loadJavaFunctions(CatalogServiceCatalog.java:1757)
at
org.apache.impala.catalog.CatalogServiceCatalog.invalidateDb(CatalogServiceCatalog.java:1862)
at
org.apache.impala.catalog.CatalogServiceCatalog.reset(CatalogServiceCatalog.java:1994)
at org.apache.impala.service.JniCatalog.<init>(JniCatalog.java:167)
Caused by: java.lang.ClassNotFoundException:
com.google.i18n.phonenumbers.NumberParseException
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
... 9 more{noformat}
This is related to a special UDF we create for testing:
https://github.com/apache/impala/blob/master/java/test-hive-udfs/src/main/java/org/apache/impala/UnresolvedUdf.java#L21
I reproduced this locally by running:
{noformat}
cd tests
./run-tests.py --skip-parallel --exploration_strategy=exhaustive
custom_cluster/test_permanent_udfs.py{noformat}
It goes away if I revert the fix for IMPALA-10997, so it looks related to that.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
