Wenzhe Zhou created IMPALA-13850:
------------------------------------
Summary: Catalogd should not start metadata operation until
initialization is done if HA is enabled
Key: IMPALA-13850
URL: https://issues.apache.org/jira/browse/IMPALA-13850
Project: IMPALA
Issue Type: Bug
Components: Catalog
Reporter: Wenzhe Zhou
In a case reported by user, the catalogd initialization failed to complete. Log
messages showed that catalog HA was enabled. catalogd was blocked when trying
to acquire "CatalogServer.catalog_lock_" when calling
CatalogServer::UpdateActiveCatalogd() during statestore subscriber registration.
Log message showed that there was IM command issued before catalogd tried to
register to statestore.
{code:java}
I0310 12:21:34.093617 1 CatalogServiceCatalog.java:2188] Invalidated all
metadata.
I0310 12:21:34.094341 1 thrift-server.cc:419] ThriftServer
'StatestoreSubscriber' started on port: 23020
I0310 12:21:34.094341 1816 TAcceptQueueServer.cpp:329]
connection_setup_thread_pool_size is set to 2
I0310 12:21:34.094586 1 thrift-util.cc:198] TSocket::open() error on socket
(after THRIFT_POLL) <Host: localhost Port: 23020>: Connection refused
I0310 12:21:34.094790 1 statestore-subscriber.cc:745] Starting statestore
subscriber
{code}
We should not allow any metadata operation until initialization is done. When
HA is enabled, catalog-server should not hold "CatalogServer.catalog_lock_" for
long time before active catalogd is assigned.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
