[
https://issues.apache.org/jira/browse/IMPALA-6725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Alex Rodoni closed IMPALA-6725.
-------------------------------
> Impala 2.12 & 3.0 Docs: KRPC Milestone 1
> ----------------------------------------
>
> Key: IMPALA-6725
> URL: https://issues.apache.org/jira/browse/IMPALA-6725
> Project: IMPALA
> Issue Type: Sub-task
> Components: Docs
> Affects Versions: Impala 3.0, Impala 2.12.0
> Reporter: Alex Rodoni
> Assignee: Alex Rodoni
> Priority: Major
>
> IMPALA-2567 replaces the RPC system for transmitting data between Impala
> backends with Kudu RPC which provides asynchronous RPC and connection
> multiplexing. Previously, Impala uses Thrift RPC and Impala will create a
> connection and a thread between each fragment instance pair. This leads to
> excessive number of connections and threads created when running complex
> queries on a moderate size cluster, causing crashes of Impala and inefficient
> CPU scheduling. After switching to KRPC, the number of threads responsible
> for RPC transportation will be fixed. There is only one pair of connection
> between any two hosts, one for each direction. Note that we still use the
> legacy thrift RPC system for some other RPCs between Impala backends so we
> may still exert some pressure on KDC in a cold cluster. We plan to eventually
> replace all RPCs between Impala backends with KRPC.
> This KRPC feature is enabled by default and it can be disabled by using the
> start-up flag --use_krpc=false.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
