[
https://issues.apache.org/jira/browse/HADOOP-767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12522221
]
Marco Nicosia commented on HADOOP-767:
--------------------------------------
It'd be great if this could get assigned to a release; we've stumbled on it
recently while trying to pipe input via hadoop dfs -put - ...
Given that's how we've been telling users to load data from outside of the
cluster, I vote +1
> timeout when writing dfs file causes infinite loop when closing the file
> ------------------------------------------------------------------------
>
> Key: HADOOP-767
> URL: https://issues.apache.org/jira/browse/HADOOP-767
> Project: Hadoop
> Issue Type: Bug
> Components: dfs
> Affects Versions: 0.8.0
> Reporter: Nigel Daley
> Assignee: Sameer Paranjpye
>
> If, when writing to a dfs file, I get a timeout exception:
> 06/11/29 11:16:05 WARN fs.DFSClient: Error while writing.
> java.net.SocketTimeoutException: timed out waiting for rpc response
> at org.apache.hadoop.ipc.Client.call(Client.java:469)
> at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:164)
> at org.apache.hadoop.dfs.$Proxy0.reportWrittenBlock(Unknown Source)
> at
> org.apache.hadoop.dfs.DFSClient$DFSOutputStream.internalClose(DFSClient.java:1220)
> at
> org.apache.hadoop.dfs.DFSClient$DFSOutputStream.endBlock(DFSClient.java:1175)
> at
> org.apache.hadoop.dfs.DFSClient$DFSOutputStream.flush(DFSClient.java:1121)
> at
> org.apache.hadoop.dfs.DFSClient$DFSOutputStream.write(DFSClient.java:1103)
> at org.apache.hadoop.examples.NNBench2.createWrite(NNBench2.java:107)
> at org.apache.hadoop.examples.NNBench2.main(NNBench2.java:247)
> then the close() operation on the file appears to go into an infinite loop of
> retrying:
> 06/11/29 13:11:19 INFO fs.DFSClient: Could not complete file, retrying...
> 06/11/29 13:11:20 INFO fs.DFSClient: Could not complete file, retrying...
> 06/11/29 13:11:21 INFO fs.DFSClient: Could not complete file, retrying...
> 06/11/29 13:11:23 INFO fs.DFSClient: Could not complete file, retrying...
> 06/11/29 13:11:24 INFO fs.DFSClient: Could not complete file, retrying...
> ...
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
