[
https://issues.apache.org/jira/browse/HDDS-3283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Janus Chow updated HDDS-3283:
-----------------------------
Target Version/s: 1.5.0 (was: 1.4.0)
I am managing the 1.4.0 release and we currently have more than 500 issues
targeted for 1.4.0. I am moving the target field to 1.5.0.
If you are actively working on this jira and believe this should be targeted
for the 1.4.0 release, Please reach out to me via Apache email or Slack.
> Improve write efficiency by decreasing the number of force sync to disk
> -----------------------------------------------------------------------
>
> Key: HDDS-3283
> URL: https://issues.apache.org/jira/browse/HDDS-3283
> Project: Apache Ozone
> Issue Type: Improvement
> Reporter: runzhiwang
> Assignee: runzhiwang
> Priority: Major
> Labels: TriagePending, performance
>
> The whole write cost about 140ms, and 110ms was cost by force sync to disk.
> The force sync operations are as follows.
> *RocksDB*
> 1. When create key, the response was put into
> [omDoubleBufferHelper|https://github.com/apache/hadoop-ozone/blob/master/hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/key/OMKeyCreateRequest.java#L264],
> and sync to disk by
> [writeOptions.setSync(true)|https://github.com/apache/hadoop-ozone/blob/master/hadoop-hdds/framework/src/main/java/org/apache/hadoop/hdds/utils/db/DBStoreBuilder.java#L171]
> 2. When commit key, the response was put into
> [omDoubleBufferHelper|https://github.com/apache/hadoop-ozone/blob/master/hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/key/OMKeyCommitRequest.java#L222],
> and sync to disk by
> [writeOptions.setSync(true)|https://github.com/apache/hadoop-ozone/blob/master/hadoop-hdds/framework/src/main/java/org/apache/hadoop/hdds/utils/db/DBStoreBuilder.java#L171]
> *Ratis*
> 1. leader and follower [sync
> |https://github.com/apache/incubator-ratis/blob/master/ratis-server/src/main/java/org/apache/ratis/server/raftlog/segmented/BufferedWriteChannel.java#L86]
> raftlog to disk
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
