[ 
https://issues.apache.org/jira/browse/RATIS-1312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17295708#comment-17295708
 ] 

Tsz-wo Sze commented on RATIS-1312:
-----------------------------------

> ... Following is the test result on 3 datanodes cluster without writting 
> disk, ...

Could you try also writing to disk?  Netty may make a difference since it has 
less buffer copying.

> ... datanode mostly will not write more than 4096 files at the same time.

This is not true.  We did have many experience that our customer clusters hit 
the limit and there was nothing we can do, expect for asking them to reduce the 
load.

> ...  So streaming & ozone can out outperform hdfs.

I guess you want say "cannot  outperform hdfs."  Let's don't jump to the 
conclusion at this stage, although I understand that you have run a lot of 
tests.

Let's explore the netty configuration and see if we could find something.  We 
should ask the netty community.



> Compare the performance between HDFS and DataStreamApi
> ------------------------------------------------------
>
>                 Key: RATIS-1312
>                 URL: https://issues.apache.org/jira/browse/RATIS-1312
>             Project: Ratis
>          Issue Type: Sub-task
>            Reporter: runzhiwang
>            Priority: Major
>         Attachments: hdfs.svg, screenshot-1.png, streaming.svg
>
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to