Re: Hadoop execution failure

Thu, 04 May 2023 19:21:14 -0700

What is the bug here? Connection reset by peer, mostly n/w issue or the client aborted the connection.

What were you executing? Is this intermittent? What is the state of the task that you ran? Is it happening for all operations or few?

Mostly this ain’t a bug but some issue with your cluster

-Ayush

Sent from my iPhone

On 05-May-2023, at 7:42 AM, 马福辰 <fuchenma...@gmail.com> wrote:


I found a bug when executing the hadoop in namenode, the version is 3.3.2. The namenode throws the following trace:
```
2023-03-27 17:35:23,759 INFO org.apache.hadoop.ipc.Server: Socket Reader #1 for port 9000: readAndProcess from client 192.168.101.162:56078 threw exception [java.io.IOException: Connection reset by peer]
java.io.IOException: Connection reset by peer
        at java.base/sun.nio.ch.FileDispatcherImpl.read0(Native Method)
        at java.base/sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)
        at java.base/sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:276)
        at java.base/sun.nio.ch.IOUtil.read(IOUtil.java:245)
        at java.base/sun.nio.ch.IOUtil.read(IOUtil.java:223)
        at java.base/sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:370)
        at org.apache.hadoop.ipc.Server.channelRead(Server.java:3639)
        at org.apache.hadoop.ipc.Server.access$2600(Server.java:144)
        at org.apache.hadoop.ipc.Server$Connection.readAndProcess(Server.java:2262)
        at org.apache.hadoop.ipc.Server$Listener.doRead(Server.java:1449)
        at org.apache.hadoop.ipc.Server$Listener$Reader.doRunLoop(Server.java:1304)
        at org.apache.hadoop.ipc.Server$Listener$Reader.run(Server.java:1275)
2023-03-27 17:35:24,271 INFO org.apache.hadoop.ipc.Server: Socket Reader #1 for port 9000: readAndProcess from client 192.168.101.162:56084 threw exception [java.io.IOException: Connection reset by peer]
java.io.IOException: Connection reset by peer
        at java.base/sun.nio.ch.FileDispatcherImpl.read0(Native Method)
        at java.base/sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)
        at java.base/sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:276)
        at java.base/sun.nio.ch.IOUtil.read(IOUtil.java:245)
        at java.base/sun.nio.ch.IOUtil.read(IOUtil.java:223)
        at java.base/sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:370)
        at org.apache.hadoop.ipc.Server.channelRead(Server.java:3639)
        at org.apache.hadoop.ipc.Server.access$2600(Server.java:144)
        at org.apache.hadoop.ipc.Server$Connection.readAndProcess(Server.java:2262)
        at org.apache.hadoop.ipc.Server$Listener.doRead(Server.java:1449)
        at org.apache.hadoop.ipc.Server$Listener$Reader.doRunLoop(Server.java:1304)
        at org.apache.hadoop.ipc.Server$Listener$Reader.run(Server.java:1275)
```

Reply via email to