[
https://issues.apache.org/jira/browse/IMPALA-1717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Ho resolved IMPALA-1717.
--------------------------------
Resolution: Duplicate
Fix Version/s: Impala 2.12.0
> Reduce backend TCP connections per-node to be independent of the number of
> backends
> -----------------------------------------------------------------------------------
>
> Key: IMPALA-1717
> URL: https://issues.apache.org/jira/browse/IMPALA-1717
> Project: IMPALA
> Issue Type: New Feature
> Components: Distributed Exec
> Affects Versions: Impala 2.1
> Reporter: Henry Robinson
> Priority: Minor
> Labels: performance
> Fix For: Impala 2.12.0
>
>
> We currently use up to {{|nodes|*|fragments|}} TCP connections per backend.
> Eventually, we should use a fixed number of connections over which all data
> stream sending can be multiplexed, but we will probably need to move away
> from Thrift before that happens, because we will need non-blocking IO to
> avoid deadlocks.
> In the meantime, we can use a fixed-size thread-pool per fragment, and at
> least only be linear in the number of fragments.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
