[
https://issues.apache.org/jira/browse/RATIS-979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17225091#comment-17225091
]
Tsz-wo Sze commented on RATIS-979:
----------------------------------
> ... each block have a data stream ? each file maybe has a lot of data streams
> ? ...
Yes, when using streaming, we don't have to divide blocks in chunks. It is
similar to HDFS data-transfer which writes entire blocks using HDFS pipelines.
> Currently, ozone will force sync each chunk to disk because each chunk has a
> raft log, if with ratis streaming, do we no need to force sync each chunk to
> disk ? Can we only force sync each block to disk ?
For Streaming, we could only force sync each block to disk when closing the
stream.
In addition, we may support sync-to-disk (like HDFS hsync) in the streaming.
The sync in stream will only sync the data to disk but won't create a raft
transaction so that it will not has a raft log.
> Ratis streaming
> ---------------
>
> Key: RATIS-979
> URL: https://issues.apache.org/jira/browse/RATIS-979
> Project: Ratis
> Issue Type: New Feature
> Components: Streaming
> Reporter: Tsz-wo Sze
> Assignee: Tsz-wo Sze
> Priority: Major
> Attachments: RatisStreaming20200929.pdf
>
>
> In this JIRA, we design and implement Ratis Streaming with zero buffer
> copying and asynchronous event driven.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
