[
https://issues.apache.org/jira/browse/HDDS-10890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei-Chiu Chuang updated HDDS-10890:
-----------------------------------
Description:
hdds.container.ratis.log.appender.queue.num-elements default value is 1. This
is the bottleneck at DN Ratis.
With the default value, I got about 2500 requests per second using freon dn
echo tool.
Increasing it to 32, I managed to 5500 requests per second,
This is still lower than OM echo on the same machine (~160k requests per
second), so I'll keep looking for other efficiencies.
NOTE: this Ozone configuration is associated with Ratis property
raft.server.log.appender.buffer.element-limit. The default value for Ozone
Manager Ratis is 1024 (defined by
ozone.om.ratis.log.appender.queue.num-elements)
{noformat}
<property>
<name>hdds.container.ratis.log.appender.queue.num-elements
</name>
<value>1</value>
<tag>OZONE, DEBUG, CONTAINER, RATIS</tag>
<description>Limit for number of append entries in ratis leader's
log appender queue.
</description>
</property>
{noformat}
was:
hdds.container.ratis.log.appender.queue.num-elements default value is 1. This
is the bottleneck at DN Ratis.
With the default value, I got about 2500 requests per second using freon dn
echo tool.
Increasing it to 32, I managed to 5500 requests per second,
This is still lower than OM echo on the same machine (~160k requests per
second), so I'll keep looking for other efficiencies.
> [hsync] Increase default value for
> hdds.container.ratis.log.appender.queue.num-elements
> ---------------------------------------------------------------------------------------
>
> Key: HDDS-10890
> URL: https://issues.apache.org/jira/browse/HDDS-10890
> Project: Apache Ozone
> Issue Type: Sub-task
> Reporter: Wei-Chiu Chuang
> Assignee: Wei-Chiu Chuang
> Priority: Major
>
> hdds.container.ratis.log.appender.queue.num-elements default value is 1. This
> is the bottleneck at DN Ratis.
> With the default value, I got about 2500 requests per second using freon dn
> echo tool.
> Increasing it to 32, I managed to 5500 requests per second,
> This is still lower than OM echo on the same machine (~160k requests per
> second), so I'll keep looking for other efficiencies.
> NOTE: this Ozone configuration is associated with Ratis property
> raft.server.log.appender.buffer.element-limit. The default value for Ozone
> Manager Ratis is 1024 (defined by
> ozone.om.ratis.log.appender.queue.num-elements)
> {noformat}
> <property>
> <name>hdds.container.ratis.log.appender.queue.num-elements
> </name>
> <value>1</value>
> <tag>OZONE, DEBUG, CONTAINER, RATIS</tag>
> <description>Limit for number of append entries in ratis leader's
> log appender queue.
> </description>
> </property>
> {noformat}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
