Ivan Andika created HDDS-17862:
----------------------------------

             Summary: Support server-side EC fan-out
                 Key: HDDS-17862
                 URL: https://issues.apache.org/jira/browse/HDDS-17862
             Project: Apache Ozone
          Issue Type: Improvement
            Reporter: Ivan Andika
            Assignee: Ivan Andika


This is just an idea for discussion.

Ozone currently makes the client to be in charge of writing the transmit the EC 
stripes to all the datanodes similar to HDFS. However, other systems like Minio 
/ RustFS and SeaweedFS implements the EC stripes writing to one of the datanode.

I can see multiple benefits
 * Assume that a client machine is further to the datanodes than the datanodes 
themselves. Making the striping done in the datanode makes the latency to be 
improved.
 * Clients do not need to open many socket to different datanodes which can 
save resources.

We can consider the approach where the datanode is in charge of spreading the 
stripes to other datanodes.

 



--
This message was sent by Atlassian Jira
(v10.3.26#10030026)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to