[
https://issues.apache.org/jira/browse/HDFS-15078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17002714#comment-17002714
]
Fei Hui edited comment on HDFS-15078 at 12/24/19 7:58 AM:
----------------------------------------------------------
This fix can resolve some scenarios
logs as follow
{quote}
2019-12-24 15:46:20,717 INFO org.apache.hadoop.ipc.Server: IPC Server handler
53 on 8888, call org.apache.hadoop.hdfs.protocol.ClientProtocol.getFileInfo f
rom 10.xx.xx.xx:60980 Call#18 Retry#0: java.io.IOException: Connection Channel
to 10.xx.xx.xx of xxx (auth:SIMPLE) is closed!
2019-12-24 15:46:20,718 WARN org.apache.hadoop.ipc.Server: IPC Server handler
53 on 8888, call org.apache.hadoop.hdfs.protocol.ClientProtocol.getFileInfo f
rom 10.xx.xx.xx:60980 Call#18 Retry#0: output error
2019-12-24 15:46:20,718 INFO org.apache.hadoop.ipc.Server: IPC Server handler
53 on 8888 caught an exception
java.nio.channels.ClosedChannelException
at
sun.nio.ch.SocketChannelImpl.ensureWriteOpen(SocketChannelImpl.java:270)
at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:461)
at org.apache.hadoop.ipc.Server.channelWrite(Server.java:2738)
at org.apache.hadoop.ipc.Server.access$2100(Server.java:134)
at
org.apache.hadoop.ipc.Server$Responder.processResponse(Server.java:1096)
at org.apache.hadoop.ipc.Server$Responder.doRespond(Server.java:1168)
at
org.apache.hadoop.ipc.Server$Connection.sendResponse(Server.java:2116)
at org.apache.hadoop.ipc.Server$Connection.access$500(Server.java:1236)
at org.apache.hadoop.ipc.Server$Call.sendResponse(Server.java:638)
at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2252)
{quote}
was (Author: ferhui):
This fix can resolve some
logs as follow
{quote}
2019-12-24 15:46:20,717 INFO org.apache.hadoop.ipc.Server: IPC Server handler
53 on 8888, call org.apache.hadoop.hdfs.protocol.ClientProtocol.getFileInfo f
rom 10.xx.xx.xx:60980 Call#18 Retry#0: java.io.IOException: Connection Channel
to 10.xx.xx.xx of xxx (auth:SIMPLE) is closed!
2019-12-24 15:46:20,718 WARN org.apache.hadoop.ipc.Server: IPC Server handler
53 on 8888, call org.apache.hadoop.hdfs.protocol.ClientProtocol.getFileInfo f
rom 10.xx.xx.xx:60980 Call#18 Retry#0: output error
2019-12-24 15:46:20,718 INFO org.apache.hadoop.ipc.Server: IPC Server handler
53 on 8888 caught an exception
java.nio.channels.ClosedChannelException
at
sun.nio.ch.SocketChannelImpl.ensureWriteOpen(SocketChannelImpl.java:270)
at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:461)
at org.apache.hadoop.ipc.Server.channelWrite(Server.java:2738)
at org.apache.hadoop.ipc.Server.access$2100(Server.java:134)
at
org.apache.hadoop.ipc.Server$Responder.processResponse(Server.java:1096)
at org.apache.hadoop.ipc.Server$Responder.doRespond(Server.java:1168)
at
org.apache.hadoop.ipc.Server$Connection.sendResponse(Server.java:2116)
at org.apache.hadoop.ipc.Server$Connection.access$500(Server.java:1236)
at org.apache.hadoop.ipc.Server$Call.sendResponse(Server.java:638)
at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2252)
{quote}
> RBF: Should check connection channel before sending rpc to namenode
> -------------------------------------------------------------------
>
> Key: HDFS-15078
> URL: https://issues.apache.org/jira/browse/HDFS-15078
> Project: Hadoop HDFS
> Issue Type: Improvement
> Components: rbf
> Affects Versions: 3.3.0
> Reporter: Fei Hui
> Assignee: Fei Hui
> Priority: Major
> Attachments: HDFS-15078.001.patch, HDFS-15078.002.patch
>
>
> dfsrouter logs show that
> {quote}
> 2019-12-20 04:11:26,724 WARN org.apache.hadoop.ipc.Server: IPC Server handler
> 6400 on 8888, call org.apache.hadoop.hdfs.protocol.ClientProtocol.create from
> 10.83.164.11:56908 Call#2 Retry#0: output error
> 2019-12-20 04:11:26,724 INFO org.apache.hadoop.ipc.Server: IPC Server handler
> 125 on 8888 caught an exception
> java.nio.channels.ClosedChannelException
> at
> sun.nio.ch.SocketChannelImpl.ensureWriteOpen(SocketChannelImpl.java:270)
> at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:461)
> at org.apache.hadoop.ipc.Server.channelWrite(Server.java:2731)
> at org.apache.hadoop.ipc.Server.access$2100(Server.java:134)
> at
> org.apache.hadoop.ipc.Server$Responder.processResponse(Server.java:1089)
> at org.apache.hadoop.ipc.Server$Responder.doRespond(Server.java:1161)
> at
> org.apache.hadoop.ipc.Server$Connection.sendResponse(Server.java:2109)
> at
> org.apache.hadoop.ipc.Server$Connection.access$400(Server.java:1229)
> at org.apache.hadoop.ipc.Server$Call.sendResponse(Server.java:631)
> at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2245)
> {quote}
> Maybe checking connection between client and router is better before
> sendingrpc to namenode
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
