Re: Performance of ratis streaming compared to Ozone [Attach image]

[Lin, Yiqun]

Hi runzhiwang/ Tsz-Wo,

Seems a very good improvement, I am interested for this.
As I see the Ratis Streaming feature (RATIS-979) is still in progress state. Do 
you know current status of this feature and if it's ready and stable for Ozone 
to use now?

Thanks,
Yiqun

On 2020/12/14, 5:40 PM, "Tsz Wo Sze" <szets...@gmail.com> wrote:

    External Email

    runzhiwang,

    Thanks a lot for working hard on Ratis Streaming and running the
    benchmarks!  Ratis Streaming is going to be a big improvement in Ozone.

    It is anticipated that Ratis Streaming can
    - improve the performance as shown in the benchmark results;
    - improve the scalability of Ozone since Streaming can reduce the number of
    pipelines in Ozone; and
    - reduce the memory requirement in datanodes.

    Regards,
    Tsz-Wo

    On Mon, Dec 14, 2020 at 4:35 PM runzhiwang <runzhiwan...@gmail.com> wrote:

    > Hi all,
    > I test the performance of ratis streaming. As the image shows, Raits
    > streaming can improve Ozone's throughput, memory usage, and stability
    > greatly.
    >
    > [image: screenshot-1.png]
    >
    > If you are interested with the test and want to reproduce it, please find
    > the details here:
    >
    > 
https://nam01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.google.com%2Fdocument%2Fd%2F1TkR4qN1ymm9UY2nRLGlvL_TjI_gTabByDN5uCUEpJiM%2Fedit&amp;data=04%7C01%7Cyiqlin%40ebay.com%7C4a8c74e9a369402a3c8f08d8a014502e%7C46326bff992841a0baca17c16c94ea99%7C0%7C0%7C637435356398333595%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000&amp;sdata=moz51OUIBm98n%2B%2FYdUtLT4Az0CE%2BgQ%2FnhpU47G5HWOY%3D&amp;reserved=0
    >
    >
    > Thanks,
    > runzhiwang
    >