[
https://issues.apache.org/jira/browse/RATIS-1312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17341832#comment-17341832
]
runzhiwang edited comment on RATIS-1312 at 5/10/21, 11:13 AM:
--------------------------------------------------------------
> I guess the bottleneck in the test is the network so that Streaming won't be
> faster than HDFS.
[~szetszwo] Another reason maybe HDFS use one thread for each block, and my
machine has 96 cores, though each thread a little slower, but because the
machine has enough CPU, so Streaming won't be faster than HDFS. If we use only
one thread for all blocks, Streaming maybe faster than HDFS.
was (Author: yjxxtd):
> I guess the bottleneck in the test is the network so that Streaming won't be
> faster than HDFS.
Another reason maybe HDFS use one thread for each block, and my machine has 96
cores, though each thread a little slower, but because the machine has enough
CPU, so Streaming won't be faster than HDFS. If we use only one thread for all
blocks, Streaming maybe faster than HDFS.
> Compare the performance between HDFS and DataStreamApi
> ------------------------------------------------------
>
> Key: RATIS-1312
> URL: https://issues.apache.org/jira/browse/RATIS-1312
> Project: Ratis
> Issue Type: Sub-task
> Reporter: runzhiwang
> Assignee: runzhiwang
> Priority: Major
> Attachments: hdfs.svg, image-2021-03-10-11-23-19-681.png,
> image-2021-03-10-11-23-42-092.png, screenshot-1.png, screenshot-2.png,
> streaming.svg
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
