[
https://issues.apache.org/jira/browse/NIFI-9820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17517010#comment-17517010
]
ASF subversion and git services commented on NIFI-9820:
-------------------------------------------------------
Commit daafd08aaebb3c4fcf149e25999d869b9fe94d3c in nifi's branch
refs/heads/support/nifi-1.16 from David Handermann
[ https://gitbox.apache.org/repos/asf?p=nifi.git;h=daafd08aae ]
NIFI-9820 Reduced Kudu Client Worker Count default setting
- Changed default Kudu Client Worker Count to number of runtime-reported
available processors
Signed-off-by: Joe Gresock <[email protected]>
This closes #5886.
> Change PutKudu Property "Kudu Client Worker Count" Default Value
> ----------------------------------------------------------------
>
> Key: NIFI-9820
> URL: https://issues.apache.org/jira/browse/NIFI-9820
> Project: Apache NiFi
> Issue Type: Improvement
> Components: Core Framework
> Affects Versions: 1.15.3
> Reporter: Josef Zahner
> Assignee: David Handermann
> Priority: Minor
> Fix For: 1.17.0, 1.16.1
>
> Time Spent: 20m
> Remaining Estimate: 0h
>
> The PutKudu processor property "Kudu Client Worker Count" has a suboptimal
> value. Please don't use the current "number of CPUs multiplied by 2"
> behaviour as it leads to a massive amount of workers in our case with
> physical servers. We have a 8-node cluster where each server has 64 CPUs. We
> have about 30 PutKudu processors configured -> a lot of worker threads per
> default just for kudu.
> We have changed the number of worker threads in our case to the number of
> concurrent tasks. I don't know, maybe it would be great to set it a bit
> higher than that, but to be honest, I don't exactly understand the impact. It
> looks still fast with the current config.
> *To sum it up, please set a low default value (eg. 4 or 8) for the property
> "Kudu Client Worker Count" and not a pseudo dynamic one for the PutKudu
> processor.*
> Btw. are there any suggestions how big the number should be?
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
