[
https://issues.apache.org/jira/browse/IMPALA-12304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17745868#comment-17745868
]
ASF subversion and git services commented on IMPALA-12304:
----------------------------------------------------------
Commit af3f56e6d1605a56f7bd02b0af35be980a7e4c63 in impala's branch
refs/heads/master from wzhou-code
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=af3f56e6d ]
IMPALA-12304: Fix the sequence number issue for update_catalogd RPC
Subscriber will re-register to statestore when statestore is restarted.
When the statestore is restarted, its sending sequence number for
update_catalogd RPC is reset. The subscribers need to reset their last
receiving sequence number of update_catalogd RPC when they successfully
re-register with statestore. Otherwise, subscribers may miss some RPCs
after statestore is restarted.
Could find related error messages in catalogd log file when run
test_catalogd_ha.py::TestCatalogdHA::test_restart_statestore.
Verified that no such error messages in catalogd log after the fix.
Made a small optimization for statestore not to wake up the thread
for update_catalogd RPC if there is no change for elected active
catalogd and there is no RPC failure in last round.
Testing:
- Passed the core test.
Change-Id: I21c1e6f6d8b047a37c7db2b7995b7ff74e317226
Reviewed-on: http://gerrit.cloudera.org:8080/20247
Tested-by: Impala Public Jenkins <[email protected]>
Reviewed-by: Wenzhe Zhou <[email protected]>
> Fix the sequence number issue for update_catalogd RPC when startestore is
> restarted
> -----------------------------------------------------------------------------------
>
> Key: IMPALA-12304
> URL: https://issues.apache.org/jira/browse/IMPALA-12304
> Project: IMPALA
> Issue Type: Improvement
> Components: Backend
> Affects Versions: Impala 4.3.0
> Reporter: Wenzhe Zhou
> Assignee: Wenzhe Zhou
> Priority: Major
> Fix For: Impala 4.3.0
>
>
> Subscriber will re-register to statestore when statestore is restarted. When
> the statestore is restarted, its sending sequence number for update_catalogd
> RPC is reset. The subscribers need to reset their last receiving sequence
> number of update_catalogd RPC when they successfully re-register with
> statestore. Otherwise, they may miss the some RPCs after statestore is
> restarted.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
