[
https://issues.apache.org/jira/browse/IMPALA-13134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17852620#comment-17852620
]
ASF subversion and git services commented on IMPALA-13134:
----------------------------------------------------------
Commit 70b7b6a78d49c30933d79e0a1c2a725f7e0a3e50 in impala's branch
refs/heads/master from wzhou-code
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=70b7b6a78 ]
IMPALA-13134: DDL hang with SYNC_DDL enabled when Catalogd is changed to
standby status
Catalogd waits for SYNC_DDL version when it processes a DDL with
SYNC_DDL enabled. If the status of Catalogd is changed from active to
standby when CatalogServiceCatalog.waitForSyncDdlVersion() is called,
the standby catalogd does not receive catalog topic updates from
statestore, hence catalogd thread waits indefinitely.
This patch fixed the issue by re-generating service id when Catalogd
is changed to standby status and throwing exception if its service id
has been changed when waiting for SYNC_DDL version.
Testing:
- Added unit-test code for CatalogD HA to run DDL with SYNC_DDL enabled
and injected delay when waiting SYNC_DLL version, then verify that
DDL query fails due to catalog failover.
- Passed test_catalogd_ha.py.
Change-Id: I2dcd628cff3c10d2e7566ba2d9de0b5886a18fc1
Reviewed-on: http://gerrit.cloudera.org:8080/21480
Reviewed-by: Riza Suminto <[email protected]>
Tested-by: Impala Public Jenkins <[email protected]>
> DDL hang with SYNC_DDL enabled when Catalogd is changed to standby status
> -------------------------------------------------------------------------
>
> Key: IMPALA-13134
> URL: https://issues.apache.org/jira/browse/IMPALA-13134
> Project: IMPALA
> Issue Type: Bug
> Components: Backend, Catalog
> Reporter: Wenzhe Zhou
> Assignee: Wenzhe Zhou
> Priority: Major
>
> Catalogd waits for SYNC_DDL version when it processes a DDL with SYNC_DDL
> enabled. If the status of Catalogd is changed from active to standby when
> CatalogServiceCatalog.waitForSyncDdlVersion() is called, the standby catalogd
> does not receive catalog topic updates from statestore. This causes catalogd
> thread waits indefinitely and DDL query hanging.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
