[ 
https://issues.apache.org/jira/browse/HDFS-12864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Elek, Marton updated HDFS-12864:
--------------------------------
    Attachment: HDFS-12864-HDFS-7240.001.patch

> Ozone: Turn off full synced write in RocksDB MetadataStore
> ----------------------------------------------------------
>
>                 Key: HDFS-12864
>                 URL: https://issues.apache.org/jira/browse/HDFS-12864
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: ozone
>            Reporter: Elek, Marton
>            Assignee: Elek, Marton
>         Attachments: HDFS-12864-HDFS-7240.001.patch
>
>
> Based on the suggestion from [~xyao] I created the patch to turn off fully 
> synced write in the rocksdb.
> With this patch we measured about 10x performance gain (200 nodes cluster + 
> 30 corona instance).
> 1. We don't need fully synced rocksdb writing, as HA will cover the few cases 
> when a node would be lost
> 2. Long term (IMHO) we need to add a possibility to configure any settings in 
> rocksdb, so it could be turned off, but the setSync(false) is a reasonable 
> default.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to