timeout when writing dfs file causes infinite loop when closing the file
------------------------------------------------------------------------
Key: HADOOP-767
URL: http://issues.apache.org/jira/browse/HADOOP-767
Project: Hadoop
Issue Type: Bug
Components: dfs
Affects Versions: 0.8.0
Reporter: Nigel Daley
If, when writing to a dfs file, I get a timeout exception:
06/11/29 11:16:05 WARN fs.DFSClient: Error while writing.
java.net.SocketTimeoutException: timed out waiting for rpc response
at org.apache.hadoop.ipc.Client.call(Client.java:469)
at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:164)
at org.apache.hadoop.dfs.$Proxy0.reportWrittenBlock(Unknown Source)
at
org.apache.hadoop.dfs.DFSClient$DFSOutputStream.internalClose(DFSClient.java:1220)
at
org.apache.hadoop.dfs.DFSClient$DFSOutputStream.endBlock(DFSClient.java:1175)
at
org.apache.hadoop.dfs.DFSClient$DFSOutputStream.flush(DFSClient.java:1121)
at
org.apache.hadoop.dfs.DFSClient$DFSOutputStream.write(DFSClient.java:1103)
at org.apache.hadoop.examples.NNBench2.createWrite(NNBench2.java:107)
at org.apache.hadoop.examples.NNBench2.main(NNBench2.java:247)
then the close() operation on the file appears to go into an infinite loop of
retrying:
06/11/29 13:11:19 INFO fs.DFSClient: Could not complete file, retrying...
06/11/29 13:11:20 INFO fs.DFSClient: Could not complete file, retrying...
06/11/29 13:11:21 INFO fs.DFSClient: Could not complete file, retrying...
06/11/29 13:11:23 INFO fs.DFSClient: Could not complete file, retrying...
06/11/29 13:11:24 INFO fs.DFSClient: Could not complete file, retrying...
...
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
