[
https://issues.apache.org/jira/browse/HDDS-4454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
runzhiwang updated HDDS-4454:
-----------------------------
Comment: was deleted
(was: [~szetszwo][~shashikant] I'm thinking whether we can change ratis
streaming to support WriteSmallFile. Here we define small file smaller than
4MB. I think there is user case which write small file frequently. If we use
the current WriteSmallFile API, there will also a lot of copy. If we change
ratis streaming, we can define a new Type STREAM_SMALL_FILE to represent
STREAM_HEADER, STREAM_DATA, STREAM_CLOSE together. what do you think ?
)
> Ozone Streaming Write Pipeline
> ------------------------------
>
> Key: HDDS-4454
> URL: https://issues.apache.org/jira/browse/HDDS-4454
> Project: Hadoop Distributed Data Store
> Issue Type: New Feature
> Components: Ozone Client, Ozone Datanode
> Reporter: Shashikant Banerjee
> Assignee: Shashikant Banerjee
> Priority: Major
> Attachments: Ozone Write Streaming.pdf,
> image-2020-11-17-09-15-58-880.png
>
>
> https://issues.apache.org/jira/browse/RATIS-979 implements streaming
> semantics in Ratis.
> Currently, ozone write pattern is bursty and involves multiple buffers copies
> as well multiple ratis log syncs in a block write. The idea of the Jira is to
> use a zero buffer copy based ratis streaming in ozone write path for better
> performance and resource utilisation.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
