I get the below error when dumping a 50G file on one of my Hadoop (0.20.2) 
clusters. It worked fine on another one though. I researched and this seems 
more like a network problem? I want to know how can I go about resolving this. 
What all should I look for on my cluster to debug this.

2010-10-15 06:01:50,014 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: 
PacketResponder blk_-1170040697541244894_3431 1 Exception java.net.SocketExcept
ion: Broken pipe
        at java.net.SocketOutputStream.socketWrite0(Native Method)
        at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:92)
        at java.net.SocketOutputStream.write(SocketOutputStream.java:136)
        at java.io.DataOutputStream.writeLong(DataOutputStream.java:207)
        at 
org.apache.hadoop.hdfs.protocol.DataTransferProtocol$PipelineAck.write(DataTransferProtocol.java:132)
        at 
org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.run(BlockReceiver.java:899)
        at java.lang.Thread.run(Thread.java:619)

2010-10-15 06:01:50,016 WARN org.apache.hadoop.hdfs.server.datanode.DataNode: 
IOException in BlockReceiver.run():
java.net.SocketException: Broken pipe
        at java.net.SocketOutputStream.socketWrite0(Native Method)
        at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:92)
        at java.net.SocketOutputStream.write(SocketOutputStream.java:136)
        at java.io.DataOutputStream.writeLong(DataOutputStream.java:207)
        at 
org.apache.hadoop.hdfs.protocol.DataTransferProtocol$PipelineAck.write(DataTransferProtocol.java:132)
        at 
org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.run(BlockReceiver.java:1001)
        at java.lang.Thread.run(Thread.java:619)
2010-10-15 06:01:50,017 WARN org.apache.hadoop.hdfs.server.datanode.DataNode: 
checkDiskError: exception:
java.net.SocketException: Broken pipe
        at java.net.SocketOutputStream.socketWrite0(Native Method)
        at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:92)
        at java.net.SocketOutputStream.write(SocketOutputStream.java:136)
        at java.io.DataOutputStream.writeLong(DataOutputStream.java:207)
        at 
org.apache.hadoop.hdfs.protocol.DataTransferProtocol$PipelineAck.write(DataTransferProtocol.java:132)
        at 
org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.run(BlockReceiver.java:1001)
        at java.lang.Thread.run(Thread.java:619)

Thanks,
Avani Sharma

Reply via email to