[
https://issues.apache.org/jira/browse/HDFS-17434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
qinyuren updated HDFS-17434:
----------------------------
Description:
In our cluster, the SendDataPacketBlockedOnNetworkNanosAvgTime metric ranges
from 5ms to 10ms, exceeding the usual disk reading overhead. Our machine
network card bandwidth is 10Gb/s.
!image-2024-03-20-19-10-13-016.png|width=662,height=135!
By adding log printing, it turns out that the Selector.select function has
significant overhead.
!image-2024-03-20-19-22-29-829.png|width=474,height=262!
!image-2024-03-20-19-24-02-233.png|width=445,height=181!
I would like to know if this falls within the normal range or how we can
improve it.
was:
In our cluster, the SendDataPacketBlockedOnNetworkNanosAvgTime metric ranges
from 5ms to 10ms, exceeding the usual disk reading overhead.
!image-2024-03-20-19-10-13-016.png|width=662,height=135!
By adding log printing, it turns out that the Selector.select function has
significant overhead.
!image-2024-03-20-19-22-29-829.png|width=474,height=262!
!image-2024-03-20-19-24-02-233.png|width=445,height=181!
I would like to know if this falls within the normal range or how we can
improve it.
> Selector.select in SocketIOWithTimeout.java has significant overhead
> --------------------------------------------------------------------
>
> Key: HDFS-17434
> URL: https://issues.apache.org/jira/browse/HDFS-17434
> Project: Hadoop HDFS
> Issue Type: Task
> Reporter: qinyuren
> Priority: Major
> Attachments: image-2024-03-20-19-10-13-016.png,
> image-2024-03-20-19-22-29-829.png, image-2024-03-20-19-24-02-233.png
>
>
> In our cluster, the SendDataPacketBlockedOnNetworkNanosAvgTime metric ranges
> from 5ms to 10ms, exceeding the usual disk reading overhead. Our machine
> network card bandwidth is 10Gb/s.
> !image-2024-03-20-19-10-13-016.png|width=662,height=135!
> By adding log printing, it turns out that the Selector.select function has
> significant overhead.
> !image-2024-03-20-19-22-29-829.png|width=474,height=262!
> !image-2024-03-20-19-24-02-233.png|width=445,height=181!
> I would like to know if this falls within the normal range or how we can
> improve it.
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
