[
https://issues.apache.org/jira/browse/IMPALA-12670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Quanlong Huang updated IMPALA-12670:
------------------------------------
Description:
TestConcurrentDdls.test_local_catalog_ddls_with_invalidate_metadata could fail
due to InconsistentMetadataFetchException:
{code:python}
tests/custom_cluster/test_concurrent_ddls.py:72: in
test_local_catalog_ddls_with_invalidate_metadata
self._run_ddls_with_invalidation(unique_database, sync_ddl=False)
tests/custom_cluster/test_concurrent_ddls.py:148: in _run_ddls_with_invalidation
worker[i].get(timeout=100)
toolchain/toolchain-packages-gcc10.4.0/python-2.7.16/lib/python2.7/multiprocessing/pool.py:572:
in get
raise self._value
E AssertionError: ImpalaBeeswaxException:
E INNER EXCEPTION: <class 'beeswaxd.ttypes.BeeswaxException'>
E MESSAGE: RuntimeException: java.util.concurrent.ExecutionException:
org.apache.impala.catalog.local.InconsistentMetadataFetchException: Fetching
TABLE failed. Could not find TCatalogObject(type:TABLE, catalog_version:0,
table:TTable(db_name:functional, tbl_name:alltypestiny))
E CAUSED BY: ExecutionException:
org.apache.impala.catalog.local.InconsistentMetadataFetchException: Fetching
TABLE failed. Could not find TCatalogObject(type:TABLE, catalog_version:0,
table:TTable(db_name:functional, tbl_name:alltypestiny))
E CAUSED BY: InconsistentMetadataFetchException: Fetching TABLE failed.
Could not find TCatalogObject(type:TABLE, catalog_version:0,
table:TTable(db_name:functional, tbl_name:alltypestiny))
E
E assert <bound method type.is_acceptable_error of <class
'test_concurrent_ddls.TestConcurrentDdls'>>("ImpalaBeeswaxException:\n INNER
EXCEPTION: <class 'beeswaxd.ttypes.BeeswaxException'>\n MESSAGE:
RuntimeException: ja...ould not find TCatalogObject(type:TABLE,
catalog_version:0, table:TTable(db_name:functional, tbl_name:alltypestiny))\n",
False)
E + where <bound method type.is_acceptable_error of <class
'test_concurrent_ddls.TestConcurrentDdls'>> =
TestConcurrentDdls.is_acceptable_error
E + and "ImpalaBeeswaxException:\n INNER EXCEPTION: <class
'beeswaxd.ttypes.BeeswaxException'>\n MESSAGE: RuntimeException: ja...ould not
find TCatalogObject(type:TABLE, catalog_version:0,
table:TTable(db_name:functional, tbl_name:alltypestiny))\n" =
str(ImpalaBeeswaxException()){code}
The exception in impalad.INFO:
{noformat}
I0103 11:19:32.221755 8786 jni-util.cc:302] 3b476356afa44e74:6f637cfa00000000]
java.lang.RuntimeException: java.util.concurrent.ExecutionException:
org.apache.impala.catalog.local.InconsistentMetadataFetchException: Fetching
TABLE failed. Could not find TCatalogObject(type:TABLE, catalog_version:0,
table:TTable(db_name:functional, tbl_name:alltypestiny))
at
org.apache.impala.catalog.local.CatalogdMetaProvider.getIfPresent(CatalogdMetaProvider.java:901)
at
org.apache.impala.catalog.local.CatalogdMetaProvider.getTableIfPresent(CatalogdMetaProvider.java:750)
at
org.apache.impala.catalog.local.LocalDb.getTableIfCached(LocalDb.java:128)
at org.apache.impala.catalog.local.LocalDb.getTable(LocalDb.java:143)
at
org.apache.impala.analysis.StmtMetadataLoader.getMissingTables(StmtMetadataLoader.java:314)
at
org.apache.impala.analysis.StmtMetadataLoader.loadTables(StmtMetadataLoader.java:169)
at
org.apache.impala.analysis.StmtMetadataLoader.loadTables(StmtMetadataLoader.java:145)
at
org.apache.impala.service.Frontend.doCreateExecRequest(Frontend.java:2348)
at
org.apache.impala.service.Frontend.getTExecRequest(Frontend.java:2110)
at
org.apache.impala.service.Frontend.createExecRequest(Frontend.java:1883)
at
org.apache.impala.service.JniFrontend.createExecRequest(JniFrontend.java:169)
Caused by: java.util.concurrent.ExecutionException:
org.apache.impala.catalog.local.InconsistentMetadataFetchException: Fetching
TABLE failed. Could not find TCatalogObject(type:TABLE, catalog_version:0,
table:TTable(db_name:functional, tbl_name:alltypestiny))
at
java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:357)
at
java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1908)
at
org.apache.impala.catalog.local.CatalogdMetaProvider.getIfPresent(CatalogdMetaProvider.java:898)
... 10 more
Caused by: org.apache.impala.catalog.local.InconsistentMetadataFetchException:
Fetching TABLE failed. Could not find TCatalogObject(type:TABLE,
catalog_version:0, table:TTable(db_name:functional, tbl_name:alltypestiny))
at
org.apache.impala.catalog.local.CatalogdMetaProvider.sendRequest(CatalogdMetaProvider.java:465)
at
org.apache.impala.catalog.local.CatalogdMetaProvider.access$100(CatalogdMetaProvider.java:199)
at
org.apache.impala.catalog.local.CatalogdMetaProvider$4.call(CatalogdMetaProvider.java:776)
at
org.apache.impala.catalog.local.CatalogdMetaProvider$4.call(CatalogdMetaProvider.java:768)
at
org.apache.impala.catalog.local.CatalogdMetaProvider.loadWithCaching(CatalogdMetaProvider.java:562)
at
org.apache.impala.catalog.local.CatalogdMetaProvider.loadTable(CatalogdMetaProvider.java:764)
at
org.apache.impala.catalog.local.LocalTable.loadTableMetadata(LocalTable.java:152)
at org.apache.impala.catalog.local.LocalTable.load(LocalTable.java:104)
at org.apache.impala.catalog.local.LocalDb.getTable(LocalDb.java:147)
... 7 more{noformat}
Other tests in TestConcurrentDdls that use local catalog mode could also hit
the same issue, e.g. test_mixed_catalog_ddls_with_invalidate_metadata.
was:
TestConcurrentDdls.test_local_catalog_ddls_with_invalidate_metadata could fail
due to InconsistentMetadataFetchException:
{code:python}
tests/custom_cluster/test_concurrent_ddls.py:72: in
test_local_catalog_ddls_with_invalidate_metadata
self._run_ddls_with_invalidation(unique_database, sync_ddl=False)
tests/custom_cluster/test_concurrent_ddls.py:148: in _run_ddls_with_invalidation
worker[i].get(timeout=100)
toolchain/toolchain-packages-gcc10.4.0/python-2.7.16/lib/python2.7/multiprocessing/pool.py:572:
in get
raise self._value
E AssertionError: ImpalaBeeswaxException:
E INNER EXCEPTION: <class 'beeswaxd.ttypes.BeeswaxException'>
E MESSAGE: RuntimeException: java.util.concurrent.ExecutionException:
org.apache.impala.catalog.local.InconsistentMetadataFetchException: Fetching
TABLE failed. Could not find TCatalogObject(type:TABLE, catalog_version:0,
table:TTable(db_name:functional, tbl_name:alltypestiny))
E CAUSED BY: ExecutionException:
org.apache.impala.catalog.local.InconsistentMetadataFetchException: Fetching
TABLE failed. Could not find TCatalogObject(type:TABLE, catalog_version:0,
table:TTable(db_name:functional, tbl_name:alltypestiny))
E CAUSED BY: InconsistentMetadataFetchException: Fetching TABLE failed.
Could not find TCatalogObject(type:TABLE, catalog_version:0,
table:TTable(db_name:functional, tbl_name:alltypestiny))
E
E assert <bound method type.is_acceptable_error of <class
'test_concurrent_ddls.TestConcurrentDdls'>>("ImpalaBeeswaxException:\n INNER
EXCEPTION: <class 'beeswaxd.ttypes.BeeswaxException'>\n MESSAGE:
RuntimeException: ja...ould not find TCatalogObject(type:TABLE,
catalog_version:0, table:TTable(db_name:functional, tbl_name:alltypestiny))\n",
False)
E + where <bound method type.is_acceptable_error of <class
'test_concurrent_ddls.TestConcurrentDdls'>> =
TestConcurrentDdls.is_acceptable_error
E + and "ImpalaBeeswaxException:\n INNER EXCEPTION: <class
'beeswaxd.ttypes.BeeswaxException'>\n MESSAGE: RuntimeException: ja...ould not
find TCatalogObject(type:TABLE, catalog_version:0,
table:TTable(db_name:functional, tbl_name:alltypestiny))\n" =
str(ImpalaBeeswaxException()){code}
Other tests in TestConcurrentDdls that use local catalog mode could also hit
the same issue, e.g. test_mixed_catalog_ddls_with_invalidate_metadata.
> TestConcurrentDdls.test_local_catalog_ddls_with_invalidate_metadata could
> fail due to InconsistentMetadataFetchException
> ------------------------------------------------------------------------------------------------------------------------
>
> Key: IMPALA-12670
> URL: https://issues.apache.org/jira/browse/IMPALA-12670
> Project: IMPALA
> Issue Type: Bug
> Components: Frontend
> Reporter: Quanlong Huang
> Assignee: Quanlong Huang
> Priority: Blocker
>
> TestConcurrentDdls.test_local_catalog_ddls_with_invalidate_metadata could
> fail due to InconsistentMetadataFetchException:
> {code:python}
> tests/custom_cluster/test_concurrent_ddls.py:72: in
> test_local_catalog_ddls_with_invalidate_metadata
> self._run_ddls_with_invalidation(unique_database, sync_ddl=False)
> tests/custom_cluster/test_concurrent_ddls.py:148: in
> _run_ddls_with_invalidation
> worker[i].get(timeout=100)
> toolchain/toolchain-packages-gcc10.4.0/python-2.7.16/lib/python2.7/multiprocessing/pool.py:572:
> in get
> raise self._value
> E AssertionError: ImpalaBeeswaxException:
> E INNER EXCEPTION: <class 'beeswaxd.ttypes.BeeswaxException'>
> E MESSAGE: RuntimeException: java.util.concurrent.ExecutionException:
> org.apache.impala.catalog.local.InconsistentMetadataFetchException: Fetching
> TABLE failed. Could not find TCatalogObject(type:TABLE, catalog_version:0,
> table:TTable(db_name:functional, tbl_name:alltypestiny))
> E CAUSED BY: ExecutionException:
> org.apache.impala.catalog.local.InconsistentMetadataFetchException: Fetching
> TABLE failed. Could not find TCatalogObject(type:TABLE, catalog_version:0,
> table:TTable(db_name:functional, tbl_name:alltypestiny))
> E CAUSED BY: InconsistentMetadataFetchException: Fetching TABLE failed.
> Could not find TCatalogObject(type:TABLE, catalog_version:0,
> table:TTable(db_name:functional, tbl_name:alltypestiny))
> E
> E assert <bound method type.is_acceptable_error of <class
> 'test_concurrent_ddls.TestConcurrentDdls'>>("ImpalaBeeswaxException:\n INNER
> EXCEPTION: <class 'beeswaxd.ttypes.BeeswaxException'>\n MESSAGE:
> RuntimeException: ja...ould not find TCatalogObject(type:TABLE,
> catalog_version:0, table:TTable(db_name:functional,
> tbl_name:alltypestiny))\n", False)
> E + where <bound method type.is_acceptable_error of <class
> 'test_concurrent_ddls.TestConcurrentDdls'>> =
> TestConcurrentDdls.is_acceptable_error
> E + and "ImpalaBeeswaxException:\n INNER EXCEPTION: <class
> 'beeswaxd.ttypes.BeeswaxException'>\n MESSAGE: RuntimeException: ja...ould
> not find TCatalogObject(type:TABLE, catalog_version:0,
> table:TTable(db_name:functional, tbl_name:alltypestiny))\n" =
> str(ImpalaBeeswaxException()){code}
> The exception in impalad.INFO:
> {noformat}
> I0103 11:19:32.221755 8786 jni-util.cc:302]
> 3b476356afa44e74:6f637cfa00000000] java.lang.RuntimeException:
> java.util.concurrent.ExecutionException:
> org.apache.impala.catalog.local.InconsistentMetadataFetchException: Fetching
> TABLE failed. Could not find TCatalogObject(type:TABLE, catalog_version:0,
> table:TTable(db_name:functional, tbl_name:alltypestiny))
> at
> org.apache.impala.catalog.local.CatalogdMetaProvider.getIfPresent(CatalogdMetaProvider.java:901)
> at
> org.apache.impala.catalog.local.CatalogdMetaProvider.getTableIfPresent(CatalogdMetaProvider.java:750)
> at
> org.apache.impala.catalog.local.LocalDb.getTableIfCached(LocalDb.java:128)
> at org.apache.impala.catalog.local.LocalDb.getTable(LocalDb.java:143)
> at
> org.apache.impala.analysis.StmtMetadataLoader.getMissingTables(StmtMetadataLoader.java:314)
> at
> org.apache.impala.analysis.StmtMetadataLoader.loadTables(StmtMetadataLoader.java:169)
> at
> org.apache.impala.analysis.StmtMetadataLoader.loadTables(StmtMetadataLoader.java:145)
> at
> org.apache.impala.service.Frontend.doCreateExecRequest(Frontend.java:2348)
> at
> org.apache.impala.service.Frontend.getTExecRequest(Frontend.java:2110)
> at
> org.apache.impala.service.Frontend.createExecRequest(Frontend.java:1883)
> at
> org.apache.impala.service.JniFrontend.createExecRequest(JniFrontend.java:169)
> Caused by: java.util.concurrent.ExecutionException:
> org.apache.impala.catalog.local.InconsistentMetadataFetchException: Fetching
> TABLE failed. Could not find TCatalogObject(type:TABLE, catalog_version:0,
> table:TTable(db_name:functional, tbl_name:alltypestiny))
> at
> java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:357)
> at
> java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1908)
> at
> org.apache.impala.catalog.local.CatalogdMetaProvider.getIfPresent(CatalogdMetaProvider.java:898)
> ... 10 more
> Caused by:
> org.apache.impala.catalog.local.InconsistentMetadataFetchException: Fetching
> TABLE failed. Could not find TCatalogObject(type:TABLE, catalog_version:0,
> table:TTable(db_name:functional, tbl_name:alltypestiny))
> at
> org.apache.impala.catalog.local.CatalogdMetaProvider.sendRequest(CatalogdMetaProvider.java:465)
> at
> org.apache.impala.catalog.local.CatalogdMetaProvider.access$100(CatalogdMetaProvider.java:199)
> at
> org.apache.impala.catalog.local.CatalogdMetaProvider$4.call(CatalogdMetaProvider.java:776)
> at
> org.apache.impala.catalog.local.CatalogdMetaProvider$4.call(CatalogdMetaProvider.java:768)
> at
> org.apache.impala.catalog.local.CatalogdMetaProvider.loadWithCaching(CatalogdMetaProvider.java:562)
> at
> org.apache.impala.catalog.local.CatalogdMetaProvider.loadTable(CatalogdMetaProvider.java:764)
> at
> org.apache.impala.catalog.local.LocalTable.loadTableMetadata(LocalTable.java:152)
> at
> org.apache.impala.catalog.local.LocalTable.load(LocalTable.java:104)
> at org.apache.impala.catalog.local.LocalDb.getTable(LocalDb.java:147)
> ... 7 more{noformat}
> Other tests in TestConcurrentDdls that use local catalog mode could also hit
> the same issue, e.g. test_mixed_catalog_ddls_with_invalidate_metadata.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
