[
https://issues.apache.org/jira/browse/HDDS-9784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17791100#comment-17791100
]
Michel Sumbul commented on HDDS-9784:
-------------------------------------
[~XiChen]and [~szetszwo] we observed the same thing in our cluster.
I question for you is what is a safe value for that parametter? I set it to 1ms
as we thought that was the smallest number we could set. Is it safe to set it
to 5us?
Is there any edge case to be aware of? anything could go wrong?
Thanks,
Michel
> Datanode Write performance degradation
> --------------------------------------
>
> Key: HDDS-9784
> URL: https://issues.apache.org/jira/browse/HDDS-9784
> Project: Apache Ozone
> Issue Type: Bug
> Components: Ozone Datanode
> Reporter: ChenXi
> Priority: Blocker
> Attachments: image-2023-11-28-15-12-49-200.png,
> image-2023-11-28-15-13-39-193.png, image-2023-11-28-15-14-12-518.png,
> image-2023-11-28-15-17-47-458.png, image-2023-11-28-15-18-12-206.png,
> image-2023-11-28-15-21-49-301.png, image-2023-11-29-11-00-42-782.png,
> image-2023-11-29-11-05-49-209.png, image-2023-11-29-11-06-30-963.png,
> image-2023-11-29-11-07-01-321.png, image-2023-11-29-13-19-18-869.png,
> image-2023-11-29-19-31-07-482.png, image-2023-11-29-19-45-03-787.png,
> image-2023-11-29-19-45-10-996.png, image-2023-11-29-19-45-31-747.png,
> image-2023-11-29-19-47-18-429.png
>
>
> h2. Summary
> Default value of hdds.ratis.raft.server.log.appender.wait-time.min 1ms causes
> write new energy to degrade.
>
> h2. Testing commands
> Datanode Write performance degradation:
> command
> ozone freon ommg --operation CREATE_KEY -n 10000000 --volume=s3v
> --bucket=bucket-object -t 50 --size 4k
> h2. Bad Performance
> <property>
> <name>hdds.ratis.raft.server.log.appender.wait-time.min</name>
> <value>1ms</value>
> </property>
> !image-2023-11-28-15-14-12-518.png!
>
> h2. Normal Performance
> <property>
> <name>hdds.ratis.raft.server.log.appender.wait-time.min</name>
> <value>0</value>
> </property>
> !image-2023-11-28-15-13-39-193.png!
> !image-2023-11-29-13-19-18-869.png!
> h2. Other testing data can be referred to.
> 0 size performance, about 8000 QPS, this represents the highest write
> performance of any OM.
> the `hdds.ratis.raft.server.log.appender.wait-time.min` of om had been set to
> 0ms by default.
> !image-2023-11-28-15-18-12-206.png!
>
> This represents the performance limit of the DN, about 6000 QPS, which can
> indicate that the cluster itself has normal read/write performance.
> !image-2023-11-28-15-21-49-301.png!
>
> h2. Cluster info
> * Number of Datanodes 6
> * 12disks per Datanode
> * HA mode for both OM and SCM
> * Ozone version: ozone.git -r 60bb0604217fbd44dbc6b115b59fc26a297fcaba
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
