[
https://issues.apache.org/jira/browse/RATIS-979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17278489#comment-17278489
]
Tsz-wo Sze commented on RATIS-979:
----------------------------------
HDFS probably has more than 5 times buffer copying when a client writing data
to a datanode pipeline. I believe Ratis streaming definitely can improve HDFS
performance.
One idea is to make Ratis Streaming a separated library/module (i.e. separate
from Ratis Raft implementation). Then any applications, which do not care
about Raft, still can use it to transfer data.
> Ratis streaming
> ---------------
>
> Key: RATIS-979
> URL: https://issues.apache.org/jira/browse/RATIS-979
> Project: Ratis
> Issue Type: New Feature
> Components: Streaming
> Reporter: Tsz-wo Sze
> Assignee: Tsz-wo Sze
> Priority: Major
> Attachments: RatisStreaming20200929.pdf, screenshot-1.png,
> screenshot-2.png
>
>
> In this JIRA, we design and implement Ratis Streaming with zero buffer
> copying and asynchronous event driven.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
