[
https://issues.apache.org/jira/browse/IMPALA-12655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17813762#comment-17813762
]
David Rorke commented on IMPALA-12655:
--------------------------------------
I'm seeing the same issue in org.apache.impala.planner.TpcdsCpuCostPlannerTest.
Stats computation is failing due to connection timeouts in HMS. Repeated
timeouts in the HMS logs:
{noformat}
2024-02-01T18:57:28,627 WARN [TThreadPoolServer WorkerProcess-196]
metastore.ObjectStore: Failed to get database
hive.tpcds_partitioned_parquet_snap, returning NoSuchObjectException
org.apache.hadoop.hive.metastore.api.MetaException: objectstore - Connection is
not available, request timed out after 30000ms.
at
org.apache.hadoop.hive.metastore.ObjectStore$GetHelper.run(ObjectStore.java:4310)
~[hive-standalone-metastore-3.1.3000.2024.0.17.0-65.jar:3.1.3000.2024.0.17.0-65]
at
org.apache.hadoop.hive.metastore.ObjectStore.getDatabaseInternal(ObjectStore.java:903)
~[hive-standalone-metastore-3.1.3000.2024.0.17.0-65.jar:3.1.3000.2024.0.17.0-65]
at
org.apache.hadoop.hive.metastore.ObjectStore.getDatabase(ObjectStore.java:875)
[hive-standalone-metastore-3.1.3000.2024.0.17.0-65.jar:3.1.3000.2024.0.17.0-65]
at sun.reflect.GeneratedMethodAccessor10.invoke(Unknown Source) ~[?:?]
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
~[?:1.8.0_261]
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_261]
at
org.apache.hadoop.hive.metastore.RawStoreProxy.invoke(RawStoreProxy.java:97)
[hive-standalone-metastore-3.1.3000.2024.0.17.0-65.jar:3.1.3000.2024.0.17.0-65]
at com.sun.proxy.$Proxy33.getDatabase(Unknown Source) [?:?]
at
org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.get_database_core(HiveMetaStore.java:1610)
[hive-standalone-metastore-3.1.3000.2024.0.17.0-65.jar:3.1.3000.2024.0.17.0-65]
at
org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.alter_table_core(HiveMetaStore.java:6359)
[hive-standalone-metastore-3.1.3000.2024.0.17.0-65.jar:3.1.3000.2024.0.17.0-65]
at
org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.alter_table_req(HiveMetaStore.java:6330)
[hive-standalone-metastore-3.1.3000.2024.0.17.0-65.jar:3.1.3000.2024.0.17.0-65]{noformat}
> PlannerTest.testProcessingCost seems flaky
> ------------------------------------------
>
> Key: IMPALA-12655
> URL: https://issues.apache.org/jira/browse/IMPALA-12655
> Project: IMPALA
> Issue Type: Bug
> Components: Frontend
> Reporter: Csaba Ringhofer
> Assignee: Riza Suminto
> Priority: Major
> Attachments:
> catalogd.impala-ec2-centos79-m6i-4xlarge-ondemand-02f3.vpc.cloudera.com.jenkins.log.INFO.20231218-120036.29228.tgz,
> compute-table-stats.log, hive-metastore.log.tgz,
> impalad.impala-ec2-centos79-m6i-4xlarge-ondemand-02f3.vpc.cloudera.com.jenkins.log.INFO.20231218-120036.29280.tgz
>
>
> This is probably caused by IMPALA-12601
> https://github.com/apache/impala/commit/8661f922d3ccb21da73b9f7f8734d9113429e9bb
> The error was cause by this line:
> https://github.com/apache/impala/blob/68fe57ff8492a7afdf14a62cabd3e2b0fcade9d1/testdata/workloads/functional-planner/queries/PlannerTest/tpcds-processing-cost.test#L8185
> In the actual plan the following appeared here:
> fk/pk conjuncts: assumed fk/pk
> [~rizaon]
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
