[
https://issues.apache.org/jira/browse/RATIS-979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17286831#comment-17286831
]
runzhiwang commented on RATIS-979:
----------------------------------
{quote}Ratis/Raft provide a transaction system to synchronise the states
between the servers.
In HDFS, we need a centralised namenode to record all the metadata in memory.
That's why HDFS is hard to scale more.
We may split the centralised namenode into multiple smaller namenodes. Each
smaller namenode manages 3 datanodes. We need some way to manage these
namenodes and make them HA.
Then, we might want to combine these smaller namenodes with the datanodes. Now,
we need to synchronise the metadata between multiple nodes. That's why it is a
good idea to use Ratis in Ozone.{quote}
[~szetszwo] Hi, sorry, I have one question, I find Datanode in HDFS also need
to write some metadata in block_xx_yy.meta, but HDFS did not need ratis to
write metadata. So I'm curious about how HDFS can keep synchronise ? And can
ozone use the same method to keep synchronise.
> Ratis streaming
> ---------------
>
> Key: RATIS-979
> URL: https://issues.apache.org/jira/browse/RATIS-979
> Project: Ratis
> Issue Type: New Feature
> Components: Streaming
> Reporter: Tsz-wo Sze
> Assignee: Tsz-wo Sze
> Priority: Major
> Attachments: RatisStreaming20200929.pdf, screenshot-1.png,
> screenshot-2.png, screenshot-3.png
>
>
> In this JIRA, we design and implement Ratis Streaming with zero buffer
> copying and asynchronous event driven.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
