[
https://issues.apache.org/jira/browse/IMPALA-7985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16745579#comment-16745579
]
Andrew Sherman commented on IMPALA-7985:
----------------------------------------
Changing to use krpc will mean some subtle changes to what :shutdown can do. In
current Impala a shutdown command like ":shutdown('asherman- desktop:22001')"
is implemented by the coordinator connecting to the backend (thrift) port 22001
on asherman-desktop and asking the impalad there to shut itself down. Note that
here the name 'asherman-desktop:22001' is being used as both a logical name
(this is how impalads are referred to in, for example, the web ui) and as a
physical name (we connect to the port 22001 on asherman-desktop). When we use
krpc this will be implemented in a slightly different way. We will use the
logical name (e.g. 'asherman-desktop:22001') to look up information about the
impalad in the current cluster membership (which is maintained by the
Scheduler). From this information we will know the krpc port of the impalad
(e.g. 27001). We will then make a krpc call to that impalad asking it to shut
itself down.
Most of the time this will work as expected.
There could theoretically be cases where a distressed impalad is running but is
no longer a member of the cluster. If the impalad is not a cluster member then
we would not be able to invoke the remote shutdown.
I have two questions for [~grahn] cc: [~tarmstrong]
1) Will we continue to use host:thift-port as a logical name? As client code
will continue to connect via thrift I assume this name will continue to be used.
2) Should I worry about the cases where we might not be able to do remote
shutdown on an impalad that is not a member of the cluster?
> Port RemoteShutdown() to KRPC
> -----------------------------
>
> Key: IMPALA-7985
> URL: https://issues.apache.org/jira/browse/IMPALA-7985
> Project: IMPALA
> Issue Type: Sub-task
> Components: Distributed Exec
> Affects Versions: Impala 3.1.0
> Reporter: Michael Ho
> Assignee: Andrew Sherman
> Priority: Major
> Labels: ramp-up
>
> Port RemoteShutdown() to KRPC. It's currently implemented as Thrift RPC.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
