[
https://issues.apache.org/jira/browse/IMPALA-13208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17866908#comment-17866908
]
ASF subversion and git services commented on IMPALA-13208:
----------------------------------------------------------
Commit fcee022e6033afe8c8c072fef1274640336b8770 in impala's branch
refs/heads/master from stiga-huang
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=fcee022e6 ]
IMPALA-13208: Add cluster id to the membership and request-queue topic names
To share catalogd and statestore across Impala clusters, this adds the
cluster id to the membership and request-queue topic names. So impalads
are only visible to each other inside the same cluster, i.e. using the
same cluster id. Note that impalads are still subscribe to the same
catalog-update topic so they can share the same catalog service.
If cluster id is empty, use the original topic names.
This also adds the non-empty cluster id as the prefix of the statestore
subscriber id for impalad and admissiond.
Tests:
- Add custom cluster test
- Ran exhaustive tests
Change-Id: I2ff41539f568ef03c0ee2284762b4116b313d90f
Reviewed-on: http://gerrit.cloudera.org:8080/21573
Reviewed-by: Impala Public Jenkins <[email protected]>
Tested-by: Impala Public Jenkins <[email protected]>
> Add cluster id to the membership and request-queue topic names
> --------------------------------------------------------------
>
> Key: IMPALA-13208
> URL: https://issues.apache.org/jira/browse/IMPALA-13208
> Project: IMPALA
> Issue Type: New Feature
> Components: Backend
> Reporter: Quanlong Huang
> Assignee: Quanlong Huang
> Priority: Critical
>
> Coordinators subscribe to 3 statestore topics: catalog-update,
> impala-membership and impala-request-queue. The last two topics are about
> query scheduling. To separate the cluster or share catalogd and statestore
> across Impala clusters, we can add the cluster id to these two topic names.
> Impalads are only visible to each other inside the same cluster (i.e. using
> the same cluster id). Queries won't be scheduled across clusters.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
