[
https://issues.apache.org/jira/browse/HADOOP-3139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12584220#action_12584220
]
Koji Noguchi commented on HADOOP-3139:
--------------------------------------
> also fixed a bug in HftpFileSystem. Otherwise, distcp will show an extra
> warning message.
>
Just fyi, this is the warning message I was getting before the patch.
{noformat}
08/03/31 16:48:42 INFO mapred.JobClient: distcp
08/03/31 16:48:42 INFO mapred.JobClient: Files copied=1
08/03/31 16:48:42 INFO mapred.JobClient: Bytes copied=46
08/03/31 16:48:42 INFO mapred.JobClient: Bytes expected=46
08/03/31 16:48:42 INFO mapred.JobClient: Map-Reduce Framework
08/03/31 16:48:42 INFO mapred.JobClient: Map input records=1
08/03/31 16:48:42 INFO mapred.JobClient: Map input bytes=114
08/03/31 16:48:42 INFO fs.FileSystem: FileSystem.closeAll() threw an exception:
java.io.IOException: HftpFileSystem([EMAIL PROTECTED]) and
Key([EMAIL PROTECTED]://namenode-nn:4444) do not match.
{noformat}
> DistributedFileSystem.close() introduces a deadlock
> ---------------------------------------------------
>
> Key: HADOOP-3139
> URL: https://issues.apache.org/jira/browse/HADOOP-3139
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs
> Reporter: Tsz Wo (Nicholas), SZE
> Assignee: Tsz Wo (Nicholas), SZE
> Priority: Blocker
> Fix For: 0.17.0
>
> Attachments: 3139_20080331.patch
>
>
> Koji found the following:
> My dfs -ls hang.
> Ctrl-Z showed a deadlock state.
> {noformat}
> "Thread-0":
> at
> org.apache.hadoop.dfs.DistributedFileSystem.close(DistributedFileSystem.java:190)
> - waiting to lock <0xedde8788> (a
> org.apache.hadoop.dfs.DistributedFileSystem)
> at
> org.apache.hadoop.fs.FileSystem$Cache.closeAll(FileSystem.java:1231)
> - locked <0xee0baf88> (a org.apache.hadoop.fs.FileSystem$Cache)
> at org.apache.hadoop.fs.FileSystem.closeAll(FileSystem.java:169)
> at
> org.apache.hadoop.fs.FileSystem$ClientFinalizer.run(FileSystem.java:154)
> - locked <0xee0bae40> (a
> org.apache.hadoop.fs.FileSystem$ClientFinalizer)
> "main":
> at org.apache.hadoop.fs.FileSystem$Cache.remove(FileSystem.java:1201)
> - waiting to lock <0xee0baf88> (a
> org.apache.hadoop.fs.FileSystem$Cache)
> at org.apache.hadoop.fs.FileSystem.close(FileSystem.java:1085)
> at
> org.apache.hadoop.dfs.DistributedFileSystem.close(DistributedFileSystem.java:192)
> - locked <0xedde8788> (a org.apache.hadoop.dfs.DistributedFileSystem)
> at org.apache.hadoop.fs.FsShell.close(FsShell.java:1698)
> at org.apache.hadoop.fs.FsShell.main(FsShell.java:1712)
> Found 1 deadlock.
> {noformat}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
