[
https://issues.apache.org/jira/browse/IMPALA-10519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17287467#comment-17287467
]
ASF subversion and git services commented on IMPALA-10519:
----------------------------------------------------------
Commit c5e8c973221be640063472226a42ee6776dd9f2a in impala's branch
refs/heads/master from Thomas Tauber-Marshall
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=c5e8c97 ]
IMPALA-10519: Allow setting of num_reactors for KuduClient
The KuduClient allows setting a number of reactor threads, which are
used for sending rpcs to Kudu such as for scans. The defaults is 4
threads, which may be too few for many use cases, since there is a
single KuduClient per impalad.
This patch adds a flag --kudu_client_num_reactor_threads which allows
users to set the number of threads. The default for the flag is 4,
which reflects the current default within Kudu, to avoid possible
regressions.
Some follow up work could be to do performance experiments and set
the default empirically.
Change-Id: If2ccb9659b9223c9a5de2416b946e6313a3239ff
Reviewed-on: http://gerrit.cloudera.org:8080/17086
Reviewed-by: Impala Public Jenkins <[email protected]>
Tested-by: Impala Public Jenkins <[email protected]>
> Allow setting of num_reactors for KuduClient
> --------------------------------------------
>
> Key: IMPALA-10519
> URL: https://issues.apache.org/jira/browse/IMPALA-10519
> Project: IMPALA
> Issue Type: Improvement
> Affects Versions: Impala 4.0
> Reporter: Thomas Tauber-Marshall
> Assignee: Thomas Tauber-Marshall
> Priority: Major
>
> The KuduClient allows setting a number of reactor threads, which are used for
> sending rpcs to Kudu such as for scans. Impala does not currently set this
> value, so it defaults to 4 threads, which may be too few for many use cases,
> since there is a single KuduClient per impalad. We should determine a better
> default (eg. based on the number of cpu cores) and also expose a flag to make
> it configurable.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
