Hello Quanlong Huang, Aman Sinha, Thomas Tauber-Marshall, Vihang Karajgaonkar,
Zoltan Borok-Nagy, Tim Armstrong, Wenzhe Zhou, Impala Public Jenkins,
I'd like you to reexamine a change. Please visit
http://gerrit.cloudera.org:8080/17645
to look at the new patch set (#5).
Change subject: IMPALA-5476: Fix Catalogd restart bring about metadata is out
of sync
......................................................................
IMPALA-5476: Fix Catalogd restart bring about metadata is out of sync
The change of catalogServiceId did not trigger a full topic update
request.
During the execution of DDL or DML, restarting Catalogd will cause
catalogServiceId to change. The DDL will execute successfully, and
then directly update the local cache (not through Statestored), modify
the local catalog with the new catalogServiceId, trigger an exception,
print the exception information, but did not submit full topic update
request. The version of Catalogd is lower than Impalad, so the metadata
information synchronized from Catalogd will be lost.
Under normal circumstances, if the catalogServiceId changes, Impalad
will submit full topic update request, Impalad will receive
TUpdateCatalogCacheRequest, and is_delta is false, that is full update.
Impalad will reset the local catalog cache, and then update, and the
version of CatalogD is greater than Impalad.
Testing
add TestRestart#test_restart_catalogd in
ests/custom_cluster/test_restart_services.py
Change-Id: I9fe25f5a2a42fb432e306ef08ae35750c8f3c50c
---
M be/src/service/impala-server.cc
M tests/custom_cluster/test_restart_services.py
2 files changed, 44 insertions(+), 9 deletions(-)
git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/45/17645/5
--
To view, visit http://gerrit.cloudera.org:8080/17645
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings
Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: newpatchset
Gerrit-Change-Id: I9fe25f5a2a42fb432e306ef08ae35750c8f3c50c
Gerrit-Change-Number: 17645
Gerrit-PatchSet: 5
Gerrit-Owner: liuyao <liu...@sensorsdata.cn>
Gerrit-Reviewer: Aman Sinha <amsi...@cloudera.com>
Gerrit-Reviewer: Impala Public Jenkins <impala-public-jenk...@cloudera.com>
Gerrit-Reviewer: Quanlong Huang <huangquanl...@gmail.com>
Gerrit-Reviewer: Thomas Tauber-Marshall <tmarsh...@cloudera.com>
Gerrit-Reviewer: Tim Armstrong <tarmstr...@cloudera.com>
Gerrit-Reviewer: Vihang Karajgaonkar <vih...@cloudera.com>
Gerrit-Reviewer: Wenzhe Zhou <wz...@cloudera.com>
Gerrit-Reviewer: Zoltan Borok-Nagy <borokna...@cloudera.com>
Gerrit-Reviewer: liuyao <liu...@sensorsdata.cn>
