[jira] [Updated] (HDDS-3283) Improve write efficiency by improving RocksDB writeBatch

2020-03-25 Thread runzhiwang (Jira)


 [ 
https://issues.apache.org/jira/browse/HDDS-3283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

runzhiwang updated HDDS-3283:
-
Description: 
>From the image, you can find the whole write cost 140ms, but RocksDB 
>[writeBatch|https://github.com/apache/hadoop-ozone/blob/master/hadoop-hdds/framework/src/main/java/org/apache/hadoop/hdds/utils/db/RDBBatchOperation.java#L46]
> of two OM 
>[response|https://github.com/apache/hadoop-ozone/blob/master/hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/protocolPB/OzoneManagerProtocolServerSideTranslatorPB.java#L217],
> CreatKeyResponse and CommitKeyResponse, cost about 60ms,  about 60 / 140 = 
>43%. I will find why it cost so much and improve it.
!screenshot-1.png! 

  was:
>From the image, you can find the whole write cost 140ms, but RocksDB 
>writeBatch of two OM response, CreatKeyResponse and CommitKeyResponse, cost 
>about 60ms,  about 60 / 140 = 43%. I will find why it cost so much and improve 
>it.
!screenshot-1.png! 


> Improve write efficiency by improving RocksDB writeBatch
> 
>
> Key: HDDS-3283
> URL: https://issues.apache.org/jira/browse/HDDS-3283
> Project: Hadoop Distributed Data Store
>  Issue Type: Improvement
>Reporter: runzhiwang
>Assignee: runzhiwang
>Priority: Major
> Attachments: screenshot-1.png
>
>
> From the image, you can find the whole write cost 140ms, but RocksDB 
> [writeBatch|https://github.com/apache/hadoop-ozone/blob/master/hadoop-hdds/framework/src/main/java/org/apache/hadoop/hdds/utils/db/RDBBatchOperation.java#L46]
>  of two OM 
> [response|https://github.com/apache/hadoop-ozone/blob/master/hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/protocolPB/OzoneManagerProtocolServerSideTranslatorPB.java#L217],
>  CreatKeyResponse and CommitKeyResponse, cost about 60ms,  about 60 / 140 = 
> 43%. I will find why it cost so much and improve it.
> !screenshot-1.png! 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: ozone-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: ozone-issues-h...@hadoop.apache.org



[jira] [Updated] (HDDS-3283) Improve write efficiency by improving RocksDB writeBatch

2020-03-25 Thread runzhiwang (Jira)


 [ 
https://issues.apache.org/jira/browse/HDDS-3283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

runzhiwang updated HDDS-3283:
-
Description: 
>From the image, you can find the whole write cost 140ms, but RocksDB 
>writeBatch of two OM response, CreatKeyResponse and CommitKeyResponse, cost 
>about 60ms,  about 60 / 140 = 43%. I will find why it cost so much and improve 
>it.
!screenshot-1.png! 

> Improve write efficiency by improving RocksDB writeBatch
> 
>
> Key: HDDS-3283
> URL: https://issues.apache.org/jira/browse/HDDS-3283
> Project: Hadoop Distributed Data Store
>  Issue Type: Improvement
>Reporter: runzhiwang
>Assignee: runzhiwang
>Priority: Major
> Attachments: screenshot-1.png
>
>
> From the image, you can find the whole write cost 140ms, but RocksDB 
> writeBatch of two OM response, CreatKeyResponse and CommitKeyResponse, cost 
> about 60ms,  about 60 / 140 = 43%. I will find why it cost so much and 
> improve it.
> !screenshot-1.png! 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: ozone-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: ozone-issues-h...@hadoop.apache.org



[jira] [Updated] (HDDS-3283) Improve write efficiency by improving RocksDB writeBatch

2020-03-25 Thread runzhiwang (Jira)


 [ 
https://issues.apache.org/jira/browse/HDDS-3283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

runzhiwang updated HDDS-3283:
-
Attachment: screenshot-1.png

> Improve write efficiency by improving RocksDB writeBatch
> 
>
> Key: HDDS-3283
> URL: https://issues.apache.org/jira/browse/HDDS-3283
> Project: Hadoop Distributed Data Store
>  Issue Type: Improvement
>Reporter: runzhiwang
>Assignee: runzhiwang
>Priority: Major
> Attachments: screenshot-1.png
>
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: ozone-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: ozone-issues-h...@hadoop.apache.org