[
https://issues.apache.org/jira/browse/IMPALA-14221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18005272#comment-18005272
]
Quanlong Huang commented on IMPALA-14221:
-----------------------------------------
The above failure is due to the job using a old snapshot of the testdata. After
using the latest snapshot, the tests passed.
Another failure of these tests is
{code:python}
custom_cluster/test_restart_services.py:1138: in
test_warmup_tables_hdfs_config_file
self._test_warmup_tables(False)
custom_cluster/test_restart_services.py:1151: in _test_warmup_tables
self._verify_warmup_scheduling_order()
custom_cluster/test_restart_services.py:1169: in _verify_warmup_scheduling_order
self.assert_catalogd_log_contains("INFO", "Scheduled 14 tables to be warmed
up")
common/impala_test_suite.py:1672: in assert_catalogd_log_contains
daemon, level, line_regex, expected_count, timeout_s, dry_run)
common/impala_test_suite.py:1755: in assert_log_contains
(expected_count, log_file_path, line_regex, found, line)
E AssertionError: Expected 1 lines in file
/data0/jenkins/workspace/impala-cdw-master-staging-core-asan/repos/Impala/logs/custom_cluster_tests/catalogd.impala-ec2-centos79-m6i-4xlarge-xldisk-1c60.vpc.cloudera.com.jenkins.log.INFO.20250714-112635.17381
matching regex 'Scheduled 14 tables to be warmed up', but found 0 lines. Last
line was:
E I20250714 11:26:47.329365 18932 JniUtil.java:178] Finished getTableMetrics
request: Getting table metrics for TTableName(db_name:tpcds, table_name:store).
Time spent{code}
It's due to there is one more table in tpch created by another test: ctas_cancel
{noformat}
I20250714 11:26:39.555303 17953 CatalogServiceCatalog.java:2614] Scheduled
warmup on table tpcds.store_sales
I20250714 11:26:39.555689 17953 CatalogServiceCatalog.java:2609] Scheduled
warmup on table tpch.ctas_cancel based on wildcard
I20250714 11:26:39.555869 17953 CatalogServiceCatalog.java:2609] Scheduled
warmup on table tpch.lineitem based on wildcard
I20250714 11:26:39.555987 17953 CatalogServiceCatalog.java:2609] Scheduled
warmup on table tpch.partsupp based on wildcard
I20250714 11:26:39.556093 17953 CatalogServiceCatalog.java:2609] Scheduled
warmup on table tpch.nation based on wildcard
I20250714 11:26:39.556211 17953 CatalogServiceCatalog.java:2609] Scheduled
warmup on table tpch.part based on wildcard
I20250714 11:26:39.556311 17953 CatalogServiceCatalog.java:2609] Scheduled
warmup on table tpch.supplier based on wildcard
I20250714 11:26:39.556425 17953 CatalogServiceCatalog.java:2609] Scheduled
warmup on table tpch.orders based on wildcard
I20250714 11:26:39.556522 17953 CatalogServiceCatalog.java:2609] Scheduled
warmup on table tpch.region based on wildcard
I20250714 11:26:39.556623 17953 CatalogServiceCatalog.java:2609] Scheduled
warmup on table tpch.customer based on wildcard
I20250714 11:26:39.556723 17953 CatalogServiceCatalog.java:2614] Scheduled
warmup on table tpcds.customer
I20250714 11:26:39.556819 17953 CatalogServiceCatalog.java:2614] Scheduled
warmup on table tpcds.date_dim
I20250714 11:26:39.556905 17953 CatalogServiceCatalog.java:2614] Scheduled
warmup on table tpcds.item
I20250714 11:26:39.556998 17953 CatalogServiceCatalog.java:2614] Scheduled
warmup on table functional.#
I20250714 11:26:39.557081 17953 CatalogServiceCatalog.java:2614] Scheduled
warmup on table functional.alltypes etc #
I20250714 11:26:39.557186 17953 CatalogServiceCatalog.java:2618] Scheduled 15
tables to be warmed up {noformat}
> warmup_table tests failed in Ozone builds
> -----------------------------------------
>
> Key: IMPALA-14221
> URL: https://issues.apache.org/jira/browse/IMPALA-14221
> Project: IMPALA
> Issue Type: Bug
> Reporter: Quanlong Huang
> Assignee: Quanlong Huang
> Priority: Major
> Labels: broken-build
> Attachments:
> catalogd.impala-ec2-centos79-m6i-4xlarge-xldisk-0393.vpc.cloudera.com.jenkins.log.INFO.20250712-195235.17537,
>
> catalogd.impala-ec2-centos79-m6i-4xlarge-xldisk-0393.vpc.cloudera.com.jenkins.log.INFO.20250712-195236.17625,
> file-list-begin-1.log.gz, file-list-end-1.log.gz
>
>
> These tests failed in Ozone builds:
> {noformat}
> custom_cluster.test_catalogd_ha.TestCatalogdHA.test_warmed_up_metadata_after_failover
> custom_cluster.test_restart_services.TestWarmupCatalog.test_warmup_tables_hdfs_config_file
> custom_cluster.test_restart_services.TestWarmupCatalog.test_keeps_warmup_tables_loaded{noformat}
> The failure is
> {code:python}
> custom_cluster/test_catalogd_ha.py:539: in
> test_warmed_up_metadata_after_failover
> self._test_warmed_up_tables(catalogd.service)
> custom_cluster/test_catalogd_ha.py:547: in _test_warmed_up_tables
> catalogd.verify_table_metadata_loaded(db, table)
> common/impala_service.py:612: in verify_table_metadata_loaded
> db, table, "loaded" if expect_loaded else "not loaded")
> E AssertionError: Timeout waiting table tpcds.customer to be loaded{code}
> Checked catalogd logs, the warmup tables config file is not loaded correctly:
> {noformat}
> --warmup_tables_config_file=ofs://localhost:9862/impala/test-warehouse/warmup_table_list.txt
> ...
> W20250712 19:52:38.293475 17537 FileSystemUtil.java:1293] Failed to load the
> list of warmup tables
> Java exception follows:
> java.io.FileNotFoundException: KEY_NOT_FOUND: Key:warmup_table_list.txt not
> found
> at
> org.apache.hadoop.fs.ozone.BasicRootedOzoneClientAdapterImpl.readFile(BasicRootedOzoneClientAdapterImpl.java:385)
> at
> org.apache.hadoop.fs.ozone.BasicRootedOzoneFileSystem.lambda$open$0(BasicRootedOzoneFileSystem.java:251)
> at
> org.apache.hadoop.hdds.tracing.TracingUtil.executeInSpan(TracingUtil.java:169)
> at
> org.apache.hadoop.hdds.tracing.TracingUtil.executeInNewSpan(TracingUtil.java:159)
> at
> org.apache.hadoop.fs.ozone.BasicRootedOzoneFileSystem.open(BasicRootedOzoneFileSystem.java:247)
> at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:960)
> at
> org.apache.impala.common.FileSystemUtil.loadWarmupTableNames(FileSystemUtil.java:1278)
> at
> org.apache.impala.catalog.CatalogServiceCatalog.<init>(CatalogServiceCatalog.java:477)
> at org.apache.impala.service.JniCatalog.<init>(JniCatalog.java:168)
> I20250712 19:52:38.293606 17537 CatalogServiceCatalog.java:479] Loaded 0
> table names to warmup{noformat}
> Checked file-list-begin-1.log, the config file is not uploaded.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscr...@impala.apache.org
For additional commands, e-mail: issues-all-h...@impala.apache.org
