[
https://issues.apache.org/jira/browse/HDFS-12757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16235842#comment-16235842
]
Kihwal Lee edited comment on HDFS-12757 at 11/2/17 2:50 PM:
------------------------------------------------------------
I think it is a dupe of HDFS-12754. With the patch applied the test passes
without a deadlock.
{noformat}
-------------------------------------------------------
T E S T S
-------------------------------------------------------
Running org.apache.hadoop.hdfs.TestDFSClientRetries
Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 152.696 sec -
in org.apache.hadoop.hdfs.TestDFSClientRetries
{noformat}
Without the patch, it would timeout and the jstack showed a deadlock.
was (Author: kihwal):
I think it is a dupe of HDFS-12754. With the patch applied the test passes
without a deadlock.
> DeadLock Happened Between DFSOutputStream and LeaseRenewer when
> LeaseRenewer#renew SocketTimeException
> ------------------------------------------------------------------------------------------------------
>
> Key: HDFS-12757
> URL: https://issues.apache.org/jira/browse/HDFS-12757
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: hdfs-client
> Reporter: Jiandan Yang
> Priority: Major
> Attachments: HDFS-12757.patch
>
>
> Java stack is :
> {code:java}
> Found one Java-level deadlock:
> =============================
> "Topology-2 (735/2000)":
> waiting to lock monitor 0x00007fff4523e6e8 (object 0x00000005d3521078, a
> org.apache.hadoop.hdfs.client.impl.LeaseRenewer),
> which is held by "LeaseRenewer:admin@na61storage"
> "LeaseRenewer:admin@na61storage":
> waiting to lock monitor 0x00007fff5d41e838 (object 0x00000005ec0dfa88, a
> org.apache.hadoop.hdfs.DFSOutputStream),
> which is held by "Topology-2 (735/2000)"
> Java stack information for the threads listed above:
> ===================================================
> "Topology-2 (735/2000)":
> at
> org.apache.hadoop.hdfs.client.impl.LeaseRenewer.addClient(LeaseRenewer.java:227)
> - waiting to lock <0x00000005d3521078> (a
> org.apache.hadoop.hdfs.client.impl.LeaseRenewer)
> at
> org.apache.hadoop.hdfs.client.impl.LeaseRenewer.getInstance(LeaseRenewer.java:86)
> at
> org.apache.hadoop.hdfs.DFSClient.getLeaseRenewer(DFSClient.java:467)
> at org.apache.hadoop.hdfs.DFSClient.endFileLease(DFSClient.java:479)
> at
> org.apache.hadoop.hdfs.DFSOutputStream.setClosed(DFSOutputStream.java:776)
> at
> org.apache.hadoop.hdfs.DFSOutputStream.closeThreads(DFSOutputStream.java:791)
> at
> org.apache.hadoop.hdfs.DFSOutputStream.closeImpl(DFSOutputStream.java:848)
> - locked <0x00000005ec0dfa88> (a
> org.apache.hadoop.hdfs.DFSOutputStream)
> at
> org.apache.hadoop.hdfs.DFSOutputStream.close(DFSOutputStream.java:805)
> - locked <0x00000005ec0dfa88> (a
> org.apache.hadoop.hdfs.DFSOutputStream)
> at
> org.apache.hadoop.fs.FSDataOutputStream$PositionCache.close(FSDataOutputStream.java:72)
> at
> org.apache.hadoop.fs.FSDataOutputStream.close(FSDataOutputStream.java:106)
> ......
> "LeaseRenewer:admin@na61storage":
> at
> org.apache.hadoop.hdfs.DFSOutputStream.abort(DFSOutputStream.java:750)
> - waiting to lock <0x00000005ec0dfa88> (a
> org.apache.hadoop.hdfs.DFSOutputStream)
> at
> org.apache.hadoop.hdfs.DFSClient.closeAllFilesBeingWritten(DFSClient.java:586)
> at
> org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:453)
> - locked <0x00000005d3521078> (a
> org.apache.hadoop.hdfs.client.impl.LeaseRenewer)
> at
> org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$700(LeaseRenewer.java:76)
> at
> org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:310)
> at java.lang.Thread.run(Thread.java:834)
> Found 1 deadlock.
> {code}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
